-- Logs begin at Wed 2022-08-24 02:44:52 UTC, end at Wed 2022-08-24 04:09:02 UTC. -- Aug 24 03:25:03.855640 dv-cinder-854261-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 03:25:03.865608 dv-cinder-854261-1-smb devstack@keystone.service[81740]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 03:25:03 2022] *** Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: nodename: dv-cinder-854261-1-smb Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: machine: x86_64 Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: clock source: unix Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: pcre jit disabled Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: detected number of CPU cores: 4 Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: current working directory: / Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: detected binary path: /usr/bin/uwsgi-core Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: your processes number limit is 47680 Aug 24 03:25:03.867623 dv-cinder-854261-1-smb devstack@keystone.service[81740]: your memory page size is 4096 bytes Aug 24 03:25:03.868404 dv-cinder-854261-1-smb devstack@keystone.service[81740]: detected max file descriptor number: 2048 Aug 24 03:25:03.868404 dv-cinder-854261-1-smb devstack@keystone.service[81740]: lock engine: pthread robust mutexes Aug 24 03:25:03.868404 dv-cinder-854261-1-smb devstack@keystone.service[81740]: thunder lock: enabled Aug 24 03:25:03.868404 dv-cinder-854261-1-smb devstack@keystone.service[81740]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 03:25:03.868404 dv-cinder-854261-1-smb devstack@keystone.service[81740]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 03:25:03.907858 dv-cinder-854261-1-smb devstack@keystone.service[81740]: Python main interpreter initialized at 0x55a3ae5569c0 Aug 24 03:25:03.907858 dv-cinder-854261-1-smb devstack@keystone.service[81740]: python threads support enabled Aug 24 03:25:03.907858 dv-cinder-854261-1-smb devstack@keystone.service[81740]: your server socket listen backlog is limited to 100 connections Aug 24 03:25:03.907858 dv-cinder-854261-1-smb devstack@keystone.service[81740]: your mercy for graceful operations on workers is 90 seconds Aug 24 03:25:03.908244 dv-cinder-854261-1-smb devstack@keystone.service[81740]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 03:25:03.908321 dv-cinder-854261-1-smb devstack@keystone.service[81740]: *** Operational MODE: preforking *** Aug 24 03:25:03.908576 dv-cinder-854261-1-smb devstack@keystone.service[81740]: *** uWSGI is running in multiple interpreter mode *** Aug 24 03:25:03.908576 dv-cinder-854261-1-smb devstack@keystone.service[81740]: spawned uWSGI master process (pid: 81740) Aug 24 03:25:03.908783 dv-cinder-854261-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 03:25:03.909945 dv-cinder-854261-1-smb devstack@keystone.service[81740]: spawned uWSGI worker 1 (pid: 81788, cores: 1) Aug 24 03:25:03.909945 dv-cinder-854261-1-smb devstack@keystone.service[81740]: spawned uWSGI worker 2 (pid: 81789, cores: 1) Aug 24 03:25:03.909945 dv-cinder-854261-1-smb devstack@keystone.service[81740]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 03:25:08.311449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:08.311449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: from cryptography.utils import int_from_bytes Aug 24 03:25:08.312271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:08.312271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: from cryptography.utils import int_from_bytes Aug 24 03:25:08.312836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:08.312836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: from cryptography.utils import int_from_bytes Aug 24 03:25:08.313292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 03:25:08.313292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: from cryptography.utils import int_from_bytes Aug 24 03:25:08.364019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:25:08.367218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:25:08.367218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] command line args: [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:25:08.367218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:25:08.367218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ================================================================================ {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:25:08.367218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] admin_token = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.367578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 03:25:08.367578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 03:25:08.367695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] config_dir = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.367695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.367799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] command line args: [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 03:25:08.367856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] config_source = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.367920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 03:25:08.367985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] debug = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ================================================================================ {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 03:25:08.368109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] admin_token = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] config_dir = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] config_source = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] debug = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.368991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_config_append = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_dir = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_file = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_config_append = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.369976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_dir = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_file = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.370891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.371990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] publish_errors = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.372984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] publish_errors = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] standard_threads = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.373923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374054 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] use_journal = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] use_json = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] use_stderr = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] standard_threads = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] use_syslog = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.374908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.375078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.375207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.375343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.375479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.375612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] use_journal = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.375612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] use_json = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.375837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.375976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] use_stderr = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.376154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.376284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] use_syslog = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.376519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.376605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 03:25:08.376735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.376814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.376919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.376998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.377961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.378979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.379971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.380975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.381911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.382084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.382296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.382446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.382530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.382611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.382685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.383438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.383619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.383737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.383819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.383899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.383973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.384993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.385986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.386925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.387968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.388911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389383 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.389944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.390859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.391967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.392057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.392203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.392283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.392441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.393974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.396983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.397980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.398067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.398144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.398218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.398292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.398372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.399990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400468 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.400967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.external = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.401986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.password = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] auth.token = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.external = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.402998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.password = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] auth.token = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.403957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.404916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.405938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.406914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.407919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.408861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409601 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.409866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.410990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.411938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.412977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.413971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.414959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.415992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.416907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.417931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.418875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.419811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420499 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.420976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.421974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.422055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.424968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.425933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.426961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.427965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.428953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.429553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.430967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.431853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.432976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.433945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] role.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] role.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.434982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.435947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] role.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] role.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.436915 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.437928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.438853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.439854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.440992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.441989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.442937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.443974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.444961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.445124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.445226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.445901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.446025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.446142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.446224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.446381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.450881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.451904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.connection = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.452930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.connection = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.453939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454054 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.454939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.455949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 03:25:08.456370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81789) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 03:25:08.482378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.485547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.485547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.485716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.485716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.485716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.491494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.491952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.520861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.521094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.521603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.521867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.579905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.580111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.636543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.636773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.636917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.637162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.803746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.803969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.804193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.804414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.804699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.805426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.819708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.819941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.820169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.820417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.820638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.820859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.834566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.834735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.834941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.835171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.835389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.835604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.835816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.836396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.836615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.836849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.837077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.837297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.837538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.837729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.855591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.856081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.869202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.869437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.869669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.869923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.870951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.871174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.871391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81789) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 03:25:08.894401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.894610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.894699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.894903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.895005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.895145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.895255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.895422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.895504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 03:25:08.895689 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.895782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.895974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.896207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.896480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.896574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.896743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.905872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.906155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.906320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.906431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.906667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.906758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.906923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.907209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.913671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.914725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.917106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.917390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.917632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.917716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.917948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.918917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.919977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.920057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.920290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.920565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.943379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.943978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.944894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.945184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.945542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.945866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.950091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.950387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.950675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.950759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.951139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.951271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.957157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.957455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.957780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.958093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.961667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.961983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.962277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.962367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.962564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.964811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.964987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.965876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.982165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.982474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.982713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.983018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.986463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.986998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.989728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.990058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.990294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.990606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:08.994905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.995476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.998093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:08.998682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.001345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.001643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.001956 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.002914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.003113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.003396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.018755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.019054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.019333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.019599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.019978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.020286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.020563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.020834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.026630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.027879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.028159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.028442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.029415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.029700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.031140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.031428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.031723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.032025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.032313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.032412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.032661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.032951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.033261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.033548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.044481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.050734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.050734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.050734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.050926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.051002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.051390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.062145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.063272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.065170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.066372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.068077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.069280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.069526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.070784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.071069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.071355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.071650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.072272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.072559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.072857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.078165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.079483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.079626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.081024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.082534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.082838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.083128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.083413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.083889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.084186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.084486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.084815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.091701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.091997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.092284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.093056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.093352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.093636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.099230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.099521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.099805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.100085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.100370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.100600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81789) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 03:25:09.100700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.100887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.100975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.101173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.101257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.101989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.102942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.103128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.103213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.103391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.103472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.103673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.103951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.104232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.104516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.104781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81789) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 03:25:09.138003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3ae5569c0 pid: 81788 (default app) Aug 24 03:25:09.139393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3ae5569c0 pid: 81789 (default app) Aug 24 03:25:09.141495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18952e-9dd3-4585-9ea1-08efc0b1c80f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:09.141803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18952e-9dd3-4585-9ea1-08efc0b1c80f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:09.142084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18952e-9dd3-4585-9ea1-08efc0b1c80f None None] PATH_INFO: `/v3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:09.146235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Wed Aug 24 03:25:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:16.662631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:16.663176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:16.663176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:16.668082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:16.674613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:16.675000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:16.675162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:16.745560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: INFO dbcounter [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] Registered counter for database keystone Aug 24 03:25:16.768331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG oslo_db.sqlalchemy.engines [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:25:16.775187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writer thread running {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:25:16.962343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG passlib.handlers.bcrypt [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81788) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:25:16.962767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG passlib.handlers.bcrypt [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81788) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:25:17.017699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:17.019281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:17.151131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:25:17.644704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:17.713056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: INFO dbcounter [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] Registered counter for database keystone Aug 24 03:25:17.774967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG oslo_db.sqlalchemy.engines [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81789) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 03:25:17.774967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writer thread running {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 03:25:17.859739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322ca30-8deb-4524-aaef-7e72658508cf None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:17.864074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:17.864704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:17.864980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:17.865247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:17.873423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:17.925118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING keystone.common.rbac_enforcer.enforcer [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:25:17.925462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb20f0-f0e4-428d-8998-9e90a39b302d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:17.935072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 24 03:25:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:25:17.940998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:17.955925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870376c3-29cd-46b2-90c0-715fb356e41c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:17.960430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:17.962198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:17.962483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:17.962755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] PATH_INFO: `/v3/projects/9a304260abbd4fa38198d15914f9035c` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:17.964438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] RBAC: Authorizing `identity:get_project(project_id=9a304260abbd4fa38198d15914f9035c)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:18.020129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 03:25:18.020484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e0c34-cd90-4adc-8662-cae8928dbfaf admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:18.025881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Wed Aug 24 03:25:17 2022] GET /identity/v3/projects/9a304260abbd4fa38198d15914f9035c => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:19.919130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad273f-8518-4a0f-914b-e9192c4b8565 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:19.919669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad273f-8518-4a0f-914b-e9192c4b8565 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:19.919669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad273f-8518-4a0f-914b-e9192c4b8565 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:19.923777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:19.929463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:19.929978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:19.930071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:19.949911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:19.951461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:19.959855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 03:25:20.234756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad273f-8518-4a0f-914b-e9192c4b8565 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:20.247660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad273f-8518-4a0f-914b-e9192c4b8565 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:20.251860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f443e-ee6a-4afd-8ca3-fb7ede107d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:20.252462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f443e-ee6a-4afd-8ca3-fb7ede107d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:20.252744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f443e-ee6a-4afd-8ca3-fb7ede107d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:20.253024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f443e-ee6a-4afd-8ca3-fb7ede107d3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:20.261224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f443e-ee6a-4afd-8ca3-fb7ede107d3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:20.263050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f443e-ee6a-4afd-8ca3-fb7ede107d3e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:20.271875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Aug 24 03:25:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:25:20.278229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:20.287801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f614def-266c-459d-b734-6261ae4df5ef None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:20.292227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66809-4f03-41bb-880d-e7fad3dcec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:20.292957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66809-4f03-41bb-880d-e7fad3dcec19 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:20.293241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66809-4f03-41bb-880d-e7fad3dcec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:20.293516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66809-4f03-41bb-880d-e7fad3dcec19 admin admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:20.294872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66809-4f03-41bb-880d-e7fad3dcec19 admin admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:20.296691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66809-4f03-41bb-880d-e7fad3dcec19 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:20.298339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Wed Aug 24 03:25:20 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:22.269215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beabf7e-fb65-457b-9922-e875b1b97d6f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.269782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beabf7e-fb65-457b-9922-e875b1b97d6f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.269782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beabf7e-fb65-457b-9922-e875b1b97d6f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.271222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:22.276605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.277037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.277137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.295517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:22.296708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:22.327944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48799-6c91-4bd6-adde-82a088e061fd None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.328225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48799-6c91-4bd6-adde-82a088e061fd None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.328517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be48799-6c91-4bd6-adde-82a088e061fd None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.329864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:22.335346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.335630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.335904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.379306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG passlib.handlers.bcrypt [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81789) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 03:25:22.379754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG passlib.handlers.bcrypt [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81789) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 03:25:22.380443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:22.425462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:22.427116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:22.535411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:22.649037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.673861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.754940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fd1d2-77f3-47cc-b756-4ae43bade300 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.788810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.789942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.790231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.790512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.800764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.801564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:22.810414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:22.811464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:22.812325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:22.817179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:22.903630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.911097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a415d71-f810-4b71-8b3e-e378f6dc4dd4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.913523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:22.922093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773e280-cca5-4117-9634-0d7bbffe15fe None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:22.948608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.949461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.949746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.950057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.955557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:22.956165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:22.956442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:22.956713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:22.957380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:22.957681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:22.959092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:22.971817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:22.977685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.020609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.022223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.079689 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8c6a4-75a9-4aaa-9669-6ae4698a5b78 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.115750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.116387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.116676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.116952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.118190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.119660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.121249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 9/16] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:23.121845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 8/17] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:23.127474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.127610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.131194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.143344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.230682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dc474-615f-4816-963d-573ae1a05efa None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.230903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0d067-9f62-4e51-ac50-4493158e85ea None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.264921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.265786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.266074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.266343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.266667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.267311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.267595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.267874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.269202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.270696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.272749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:23.279747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.285840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.287308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:25:23.305742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:23.306731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:25:23.307564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:25:23.307564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:23.307564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:23.307564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:23.312592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:23.363382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.369795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:23.382065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee79d6-af77-4aed-a893-2cc79a6494f2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.415110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa08b-2ad1-43b9-9fe0-f30434ff9169 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:23.417350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.418002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.418280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.418552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.419379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.domain.id=default, user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:23.419584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.421024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7d91-02f5-4aa3-ac90-5a5f9add8235 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.427798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 24 03:25:23 2022] GET /identity/v3/role_assignments?user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2&scope.domain.id=default&role.id=bde35209edd64a3187d196af53f70e5d => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:23.451464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:23.452117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:23.452403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:23.452682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:23.453364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:23.453675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:23.455189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9918396-77e9-4b6d-9c9b-5776e2003a7d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:23.477091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:25.505799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63235-fe85-4296-a613-e85f75add64a None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.506333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63235-fe85-4296-a613-e85f75add64a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.506408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa63235-fe85-4296-a613-e85f75add64a None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.507999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:25.513619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665299af-2bdd-4edb-8cae-4ad7818822a4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.514527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665299af-2bdd-4edb-8cae-4ad7818822a4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.515003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665299af-2bdd-4edb-8cae-4ad7818822a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.543810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-665299af-2bdd-4edb-8cae-4ad7818822a4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:25.545361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-665299af-2bdd-4edb-8cae-4ad7818822a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.635551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 11/23] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:25.801464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0cf-9193-4bb9-9d0b-f79c3734d95b None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.801862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0cf-9193-4bb9-9d0b-f79c3734d95b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.802062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ba0cf-9193-4bb9-9d0b-f79c3734d95b None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.803403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 13/24] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:25.809534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955cdd-51d5-4141-a3d1-ff04433e01a1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:25.809857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955cdd-51d5-4141-a3d1-ff04433e01a1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:25.810254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a955cdd-51d5-4141-a3d1-ff04433e01a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:25.832627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0a955cdd-51d5-4141-a3d1-ff04433e01a1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:25.833864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0a955cdd-51d5-4141-a3d1-ff04433e01a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:25.896134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:25.928701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 12/25] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:26.142469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0cf-9193-4bb9-9d0b-f79c3734d95b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.257147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ba0cf-9193-4bb9-9d0b-f79c3734d95b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.296999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.297655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.297968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.298246 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.303697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc653a-e33e-4616-9e00-62ad744cb0b4 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.303989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc653a-e33e-4616-9e00-62ad744cb0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.304292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc653a-e33e-4616-9e00-62ad744cb0b4 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.305846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 13/26] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:26.312047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf2d8-2624-4e93-93b6-4944d0c1578c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.312178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:26.312380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf2d8-2624-4e93-93b6-4944d0c1578c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.312607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf2d8-2624-4e93-93b6-4944d0c1578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:26.317552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:26.318463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:26.319242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 14/27] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:26.325298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.331123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.358770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-21bcf2d8-2624-4e93-93b6-4944d0c1578c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:26.359962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-21bcf2d8-2624-4e93-93b6-4944d0c1578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:26.446568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec712a-d5f1-476a-8280-bda06772316f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.481586 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 14/28] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:26.483635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464840df-294d-4e56-b24f-00e9dfb11936 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.483930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464840df-294d-4e56-b24f-00e9dfb11936 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.484455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464840df-294d-4e56-b24f-00e9dfb11936 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.486032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 15/29] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:26.490190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464840df-294d-4e56-b24f-00e9dfb11936 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.500398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.501415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.502033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.502610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.503525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:26.504149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.505897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71525c29-178e-4e92-8f1c-74ec236ce285 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.517039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 15/30] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:26.518637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.519130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.519627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.540193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:26.541816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:26.651813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464840df-294d-4e56-b24f-00e9dfb11936 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.662512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.672080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.677165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 16/31] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:26.679626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.722628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.723198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.723480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.723752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.740215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.741508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:25:26.772037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:26.773044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:25:26.774768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:25:26.774768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:25:26.774768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:26.774768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 16/32] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:26.781334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.802651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae17df4-6dbb-4265-a4f9-7eea1eed31d7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.842805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:26.843823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:26.844309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:26.844727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:26.846210 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:26.848108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:26.849935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 17/33] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:26.856641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:26.951209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:26.959335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3459c6b-a10e-47cb-8f86-8750c27bed5d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:26.991133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326fc92-1b93-4ab0-a8b2-192c2560d3c0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.007033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.008437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.008720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.008991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.009641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:27.010213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.012086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.029234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 17/34] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:27.032792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.035266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.035926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.036211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.036487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.037997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.039974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.041795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 18/35] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:27.042603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.063758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.152732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6795e0-c018-460d-a5ba-073323cc5f27 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.168369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a53b58-d581-4b5b-ad94-f8f06fda998c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.195437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.209395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.210682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.211055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.211831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.212764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.214910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.215825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.216527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.216882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.217232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.218030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.219546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.436638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 18/36] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/roles => generated 225 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:27.437678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.480321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 19/37] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/projects => generated 301 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:27.481232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:27.540964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:27.567950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48048b6c-45fc-49f7-95a7-bb6238f092f9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.622638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598d3bc-fd52-4cd7-b36d-e991ac1dddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.623336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d3bc-fd52-4cd7-b36d-e991ac1dddf2 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.623626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d3bc-fd52-4cd7-b36d-e991ac1dddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.623913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598d3bc-fd52-4cd7-b36d-e991ac1dddf2 None admin] PATH_INFO: `/v3/domains/default/users/84b18f6adbc04f4f94e86ebc7dc7e8e2/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.626579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598d3bc-fd52-4cd7-b36d-e991ac1dddf2 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.628203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598d3bc-fd52-4cd7-b36d-e991ac1dddf2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.645348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadaad4-7a8d-4ba2-9e78-a52e83ba788c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:27.684297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14091070-237d-4762-a732-6f3a603bd774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:27.685041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091070-237d-4762-a732-6f3a603bd774 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.685322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091070-237d-4762-a732-6f3a603bd774 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.685608 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14091070-237d-4762-a732-6f3a603bd774 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.686479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091070-237d-4762-a732-6f3a603bd774 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:27.689486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14091070-237d-4762-a732-6f3a603bd774 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:27.706587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 19/38] 10.222.0.40 () {58 vars in 1361 bytes} [Wed Aug 24 03:25:27 2022] PUT /identity/v3/domains/default/users/84b18f6adbc04f4f94e86ebc7dc7e8e2/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:27.708062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761fb-5863-46a8-b562-fdead98a18e3 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.708356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761fb-5863-46a8-b562-fdead98a18e3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.708633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761fb-5863-46a8-b562-fdead98a18e3 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.709939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 20/39] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:27.711627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f372c27-91ac-4c72-b696-5c0272a50125 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.711908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f372c27-91ac-4c72-b696-5c0272a50125 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.712185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f372c27-91ac-4c72-b696-5c0272a50125 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.717882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 21/40] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:27.719596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.719893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.720179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.744985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:27.746700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:27.768718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 20/41] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/roles => generated 219 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:27.770649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:27.771106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:27.771386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:27.794700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:27.796564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:27.855843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 22/42] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:27.976536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:28.005593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 21/43] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:28.141676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:28.212977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:28.247142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabf9eb-f547-4b76-824c-5cd8bfd0d599 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:28.282259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:28.282883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:28.283175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:28.283456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:28.284251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:28.285662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:28.288607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:28.387282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 23/44] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 24 03:25:28 2022] POST /identity/v3/roles => generated 223 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:28.399297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54478d83-bd44-4ff5-b768-d54e7c7fe44d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:28.439857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0a4d1-131b-453f-935f-edefdd61a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:28.440895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a4d1-131b-453f-935f-edefdd61a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:28.441361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a4d1-131b-453f-935f-edefdd61a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:28.441946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0a4d1-131b-453f-935f-edefdd61a3f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:28.443451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0a4d1-131b-453f-935f-edefdd61a3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:28.445261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0a4d1-131b-453f-935f-edefdd61a3f0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:28.451638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 22/45] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:28.453428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:28.587138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f027762-15c4-4897-bf8b-eeed90086788 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:28.615877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:28.623595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc18b1-d592-4ca9-88ad-6b0e37c9ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:28.624216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc18b1-d592-4ca9-88ad-6b0e37c9ab3d None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:28.629708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc18b1-d592-4ca9-88ad-6b0e37c9ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:28.629708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc18b1-d592-4ca9-88ad-6b0e37c9ab3d None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:28.629708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc18b1-d592-4ca9-88ad-6b0e37c9ab3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:28.629708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc18b1-d592-4ca9-88ad-6b0e37c9ab3d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:28.724901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 24/46] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:28 2022] POST /identity/v3/projects => generated 312 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:25:29.686132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3f124-a24b-4e82-8db6-6fd9a7f8f0dc None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.686644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3f124-a24b-4e82-8db6-6fd9a7f8f0dc None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.686726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c3f124-a24b-4e82-8db6-6fd9a7f8f0dc None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.688061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 23/47] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:29.693485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:29.693811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:29.694079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:29.712397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:29.713617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:29.781469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 25/48] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:30.051282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3f124-a24b-4e82-8db6-6fd9a7f8f0dc None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.097101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.154691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c3f124-a24b-4e82-8db6-6fd9a7f8f0dc None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.188200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.188828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.189126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.189380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.199312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:30.204043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:30.204953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:30.205740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 24/49] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:30.211441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.308928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf93a0-19ee-4d67-bd59-4a174ffc5833 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.319737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.343093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.343706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.344017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.344260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.344932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:30.345263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.347101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.360392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 26/50] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.365903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.467376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f47da9-c355-48b3-9531-523f32df3c4d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.468915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.502320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.502638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.502919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.503202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.504347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.505825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.507583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 25/51] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.513073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.611960 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d65800-cdf7-420f-b7d6-c8a3afaf0c42 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.645639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f94f-5f75-4583-bd03-2411e5fc6166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.646308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f94f-5f75-4583-bd03-2411e5fc6166 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.646598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f94f-5f75-4583-bd03-2411e5fc6166 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.646879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f94f-5f75-4583-bd03-2411e5fc6166 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.648579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f94f-5f75-4583-bd03-2411e5fc6166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.650076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f94f-5f75-4583-bd03-2411e5fc6166 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.651814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 27/52] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.657437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:30.666761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93cc5-1728-43e5-8dbf-0810b9002760 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.667051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93cc5-1728-43e5-8dbf-0810b9002760 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.667335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f93cc5-1728-43e5-8dbf-0810b9002760 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.668671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 28/53] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:30.673510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.673827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.674113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.692293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:30.693517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:30.727928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:30.762593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7466-160b-496d-9640-c8d1a0817ffe None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:30.800002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:30.800889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:30.801171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:30.801447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:30.802227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.domain.id=default, user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:30.802543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:30.804021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:30.810587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 26/54] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Aug 24 03:25:30 2022] GET /identity/v3/role_assignments?user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2&scope.domain.id=default&role.id=bde35209edd64a3187d196af53f70e5d => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:30.869075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 29/55] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:31.144653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:31.178193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:31.242602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52090e2-5a31-4051-bb90-e6a5a4560764 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:31.289363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b63556-914b-4a3f-92e4-c1d824e92bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:31.290034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63556-914b-4a3f-92e4-c1d824e92bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:31.290320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63556-914b-4a3f-92e4-c1d824e92bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:31.290600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b63556-914b-4a3f-92e4-c1d824e92bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:31.291720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b63556-914b-4a3f-92e4-c1d824e92bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:31.293188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b63556-914b-4a3f-92e4-c1d824e92bf9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:31.294796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 27/56] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:31.300413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:31.398896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ffd73-ac37-4398-9dec-11b7dd5c5092 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:31.431335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df73ae1-1e85-47f2-9051-04eddbcbbe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:31.431947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df73ae1-1e85-47f2-9051-04eddbcbbe23 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:31.432231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df73ae1-1e85-47f2-9051-04eddbcbbe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:31.432506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df73ae1-1e85-47f2-9051-04eddbcbbe23 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:31.433158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df73ae1-1e85-47f2-9051-04eddbcbbe23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:31.434647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df73ae1-1e85-47f2-9051-04eddbcbbe23 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:31.541626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 30/57] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 24 03:25:31 2022] POST /identity/v3/projects => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:33.506826 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f8377-b099-49fb-a9a6-ee80beb62902 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:33.507343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f8377-b099-49fb-a9a6-ee80beb62902 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:33.507429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f8377-b099-49fb-a9a6-ee80beb62902 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:33.509340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 28/58] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:33.514777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:33.515191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:33.515344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:33.532975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:33.534269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:33.550814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:33.601330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 31/59] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:33.872680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f8377-b099-49fb-a9a6-ee80beb62902 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:33.971240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f8377-b099-49fb-a9a6-ee80beb62902 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:33.972868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:34.004778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84acc096-7f90-453e-bf1d-1da8f16e4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:34.005408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc096-7f90-453e-bf1d-1da8f16e4746 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:34.005692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc096-7f90-453e-bf1d-1da8f16e4746 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:34.006002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84acc096-7f90-453e-bf1d-1da8f16e4746 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:34.007138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc096-7f90-453e-bf1d-1da8f16e4746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:34.008573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84acc096-7f90-453e-bf1d-1da8f16e4746 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:34.010165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 29/60] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:34.015806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:34.116151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92a8e-0721-4f95-9df8-c2dd22b09eda None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:34.150530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57951d-a32c-4ef8-8854-d0d688b5ea19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:34.151119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57951d-a32c-4ef8-8854-d0d688b5ea19 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:34.151403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57951d-a32c-4ef8-8854-d0d688b5ea19 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:34.151680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57951d-a32c-4ef8-8854-d0d688b5ea19 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:34.152319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57951d-a32c-4ef8-8854-d0d688b5ea19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:34.153805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57951d-a32c-4ef8-8854-d0d688b5ea19 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:34.255414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 32/61] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:34 2022] POST /identity/v3/users => generated 275 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:37.252466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca90c-7246-47f7-a0e1-91fc7037cb34 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.253500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca90c-7246-47f7-a0e1-91fc7037cb34 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.254040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca90c-7246-47f7-a0e1-91fc7037cb34 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.255915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 30/62] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.261662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a6a90-3dac-4204-9e5f-efff437fd71c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.262556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a6a90-3dac-4204-9e5f-efff437fd71c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.263038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a6a90-3dac-4204-9e5f-efff437fd71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.290794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c59a6a90-3dac-4204-9e5f-efff437fd71c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.292388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c59a6a90-3dac-4204-9e5f-efff437fd71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.294741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.383568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 33/63] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.596173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28581b-572a-4e1b-a9c9-cbe3e835119c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.596856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28581b-572a-4e1b-a9c9-cbe3e835119c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.597344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28581b-572a-4e1b-a9c9-cbe3e835119c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.598943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 31/64] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.604375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.604908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.605418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.634787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.636355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.662352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eabc81-891e-420b-bd26-aac7c2c482f2 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.662977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eabc81-891e-420b-bd26-aac7c2c482f2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.663519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eabc81-891e-420b-bd26-aac7c2c482f2 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.665058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 32/65] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.680867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc27d5d-a272-4ed7-96d2-b94e45bc3add None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.681143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc27d5d-a272-4ed7-96d2-b94e45bc3add None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.681425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc27d5d-a272-4ed7-96d2-b94e45bc3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.711822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4fc27d5d-a272-4ed7-96d2-b94e45bc3add None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.713059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4fc27d5d-a272-4ed7-96d2-b94e45bc3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.750163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.751320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.801431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 33/67] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.834895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd5ff-65ce-4a22-a504-a6cf5114cb4d None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.835409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd5ff-65ce-4a22-a504-a6cf5114cb4d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.835839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6dd5ff-65ce-4a22-a504-a6cf5114cb4d None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.837594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 34/68] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.842691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.843170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.843594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.873528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.875130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.883254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a8004-a06c-4304-b1c3-b30cee049434 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:37.894218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:37.920982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5af7-e4bd-4201-af3c-8622ab316774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:37.921830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5af7-e4bd-4201-af3c-8622ab316774 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.922286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5af7-e4bd-4201-af3c-8622ab316774 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.922735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5af7-e4bd-4201-af3c-8622ab316774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.936278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5af7-e4bd-4201-af3c-8622ab316774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-b64f5af7-e4bd-4201-af3c-8622ab316774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:37.943559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:37.945014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:37.945827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:37.948580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 35/69] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:37.950014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d46a0-8e1d-407a-b8f2-0f4a40201c5b None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.950567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d46a0-8e1d-407a-b8f2-0f4a40201c5b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.951038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d46a0-8e1d-407a-b8f2-0f4a40201c5b None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.952482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 36/70] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:37.953895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 35/71] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:37.958141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:37.958658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:37.958936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:37.959247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:37.979583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:37.981052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:37.992228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.057969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 37/72] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:38.067198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4074d3-4c14-48bc-8561-7130487d5b50 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.109474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.110650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.111142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.111440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.111746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.112534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:38.112948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.116169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.124186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 36/73] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:38.130528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.202220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.247870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02b033-e260-4591-8b63-4611eb618344 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.262831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.271606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb841b59-66cf-4ac4-8a6a-6085256f3c15 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.295484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.296245 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.296536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.296813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.298149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.299629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.301231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 38/74] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.302190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.311174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.311821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.312103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.312381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.327129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.328598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.330282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 37/75] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:38.331208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.425094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f569423-a442-4bc1-812b-f75a642057be None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.441520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e40b57-778a-461e-ba96-8c271903e5ef None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.451528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.462245 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.462878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.464827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.464827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.474703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:38.479268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:38.479808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:38.480839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:38.481649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:38.482283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.482283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.482283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.482452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 39/76] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:38.482452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.494037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:38.500792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:38.501927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:38.502725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 38/77] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:38.504110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.518075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.583224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ac3d9-196c-41c9-b87a-12c9e510723b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.605335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29bf70-62a5-42d2-8b99-101f5abb0585 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.617152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.617783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.618079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.618362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.619008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.620485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.640285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.640897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.641181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.641454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.706743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.708126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:38.719570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.748398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 40/78] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:38 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:38.749225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.800283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.815226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 39/79] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:38.816549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.870126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b200b34-1841-4456-8101-baddc2a72a61 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.908912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.909444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.909727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.910034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.927143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:38.929401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:38.930394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:38.931168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 41/80] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:38.931812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:38.951510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72da215-0d36-4c15-83a5-c96fea77a0ed None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:38.965070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:38.989312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:38.995983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:38.995983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:38.995983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:38.995983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:38.995983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:38.995983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.007716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 40/81] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.007716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.070274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3a9d8-1c0d-4561-b53e-3c4400712d84 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.072596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.136270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1b30-9fc7-4893-89cd-38dcdf174a9d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.158907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.159537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.159825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.160104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.160790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:39.161099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.163889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.175599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 42/82] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.176551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.178130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.178781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.179261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.179630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.181807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.183365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.185840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 41/83] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.186714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.249509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.289965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0b977-2af9-4ac7-986c-049da24a7458 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.325882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09412f-1b09-4b0e-a5ed-4f27d469ae5b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.326440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.326807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.327024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.327506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.328455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:39.328956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.330706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.341496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 43/84] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.342761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.371111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.371996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.372383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.372674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.374097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.376223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.378222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.378334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 42/85] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.379118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.474577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76cc32-cf13-4f66-97d9-be7f78b299e4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.510749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136aca00-ea86-49ca-835d-30a4b56ee192 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.510949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.511412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.511863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.512284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.513614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.515346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.517108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 44/86] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.518056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.520803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.548732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.549728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.550173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.550606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.551594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=bda4269ce4624e36a0a082bab7f4df80) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:39.552049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.553794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.560898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 43/87] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/role_assignments?user.id=bda4269ce4624e36a0a082bab7f4df80&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=9386846542804a8b96776ed9753a7628 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.568137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.626234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.629132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827a012-a62d-4648-a8fe-5f70f4483684 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.665642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.666320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.666674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.666960 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.672483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.672483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.672483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 45/88] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:39.672483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:39.765269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3203e1-ed02-4616-9ec6-822373fd94f8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.785726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea3cda-d455-4cb5-95ab-f11ad22d9121 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:39.807575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.808597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.809078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.809575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.839951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:39.840652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:39.840951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:39.841227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:39.857362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.914203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:39.914801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.916300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:39.923498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:39.925086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.068088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 46/89] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:40.068974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.104611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 44/90] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:40.105537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.149930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.200801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dbb74-c0d9-455f-80b2-b54763a4fd6d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.242415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.243047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.243336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.243618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.275467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.326478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367d8ac-7a49-40ff-9479-2ffff31d0546 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.366450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.367396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.367685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.367967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.369417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.371521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.373254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 45/91] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:40.378172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.402141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.403633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.525180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.590633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872d443-72ed-49b9-95c9-96dfae9be41b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.604215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 47/92] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:40.605514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.656499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.657614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.658765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.659428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.662733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.664478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.667557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 46/93] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:40.673132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.688413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:40.792688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3d781-2831-476a-a886-b3d4f39b7461 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.830759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ca20a-2d6b-4d40-bb16-5c0c3ae73747 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:40.859532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.860080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.860368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.860647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.861390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] RBAC: Adding query filter params (role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=bda4269ce4624e36a0a082bab7f4df80) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:40.861705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.863206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.882272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 48/94] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/role_assignments?user.id=bda4269ce4624e36a0a082bab7f4df80&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:40.883187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.909630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:40.910320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:40.910608 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:40.910888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] PATH_INFO: `/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:40.913298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] RBAC: Authorizing `identity:get_project(project_id=d601b3b45a7e4bfc91a531f9f7143ea7)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:40.918496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:40.920332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 47/95] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:40.927386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:40.934519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:41.020000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5bdaa-0add-4962-887f-e27606bca4f5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:41.062094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:41.062785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.063078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.063359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.069794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:41.069794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:41.069794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb255851-b21e-42e1-8749-3ac20b839837 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:41.072973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 49/96] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/role_assignments?user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:41.079840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9e35-b439-483c-b52a-a59bc452688b None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.080231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9e35-b439-483c-b52a-a59bc452688b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.080472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9e35-b439-483c-b52a-a59bc452688b None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.081788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 50/97] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:41.088080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec7ccf-94e2-4855-8971-4ac09585147c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.088376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec7ccf-94e2-4855-8971-4ac09585147c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.088981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec7ccf-94e2-4855-8971-4ac09585147c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.112289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:41.130999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-49ec7ccf-94e2-4855-8971-4ac09585147c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:41.132292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-49ec7ccf-94e2-4855-8971-4ac09585147c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:41.155925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ca12-cac6-4fae-adc6-9a17752bb10d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:41.195576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:41.196571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.197051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.197567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.198594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, scope.project.id=d601b3b45a7e4bfc91a531f9f7143ea7, user.id=bda4269ce4624e36a0a082bab7f4df80) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:41.199162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:41.200963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465feca6-80b6-4a5f-a0d6-5ad3607c542e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:41.207518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 48/98] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:40 2022] GET /identity/v3/role_assignments?user.id=bda4269ce4624e36a0a082bab7f4df80&scope.project.id=d601b3b45a7e4bfc91a531f9f7143ea7&role.id=9386846542804a8b96776ed9753a7628 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:41.262871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb0d1d-0d3e-4560-ab93-031fb8198efc None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.263568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb0d1d-0d3e-4560-ab93-031fb8198efc None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.264071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb0d1d-0d3e-4560-ab93-031fb8198efc None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.264535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 51/99] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:41.270435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 49/100] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:41.277026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:41.277354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:41.277599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:41.315085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:41.316420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:41.339365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:41.407622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 52/101] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:41.789094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb0d1d-0d3e-4560-ab93-031fb8198efc None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:41.831920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:41.983466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb0d1d-0d3e-4560-ab93-031fb8198efc None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:41.994780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08f7df-2e07-40e3-b796-a74c718ed0ec None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.036232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148dd5b-15c5-49ae-ad1a-f238419db4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.037250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148dd5b-15c5-49ae-ad1a-f238419db4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.037795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148dd5b-15c5-49ae-ad1a-f238419db4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.038294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148dd5b-15c5-49ae-ad1a-f238419db4d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.050974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148dd5b-15c5-49ae-ad1a-f238419db4d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-e148dd5b-15c5-49ae-ad1a-f238419db4d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:42.057561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:42.058484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:42.059270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:42.062017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 53/102] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:42.063371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793651d5-588f-4d3d-ae8e-2a005e854f77 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.063979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793651d5-588f-4d3d-ae8e-2a005e854f77 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.064713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793651d5-588f-4d3d-ae8e-2a005e854f77 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.066216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 54/103] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:42.076025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.076579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.077060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.079143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.079810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.080099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.080377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.082064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.083497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.085800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 50/104] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:42.086445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.106963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:42.111017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:42.116852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.120349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.248927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33041ae-dd89-4671-bca7-f135b848c061 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.279396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 55/105] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:42.280419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.285444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.286375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.286938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.287471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.289038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:42.289834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.292455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.301409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 51/106] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:42.307308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.395380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.442166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b0a65-38fb-42c0-918d-20555bf7153b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.448900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607580a-5ab0-477d-91ef-ef778f924568 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.511672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.512324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.512616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.512900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] PATH_INFO: `/v3/users/6ce01c7e327e4055af7fcf12bfb3f9f0` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.523029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.523664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.523949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.524224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.524935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.526446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.557635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=6ce01c7e327e4055af7fcf12bfb3f9f0)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.563432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.565284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 52/107] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/users/6ce01c7e327e4055af7fcf12bfb3f9f0 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:42.565797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.571702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.650795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 56/108] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:25:42 2022] POST /identity/v3/projects => generated 302 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:42.668107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:42.747936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bad706-727c-4549-a4d2-3ad1e4593ab0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:42.778076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:42.786423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:42.787166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:42.787535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:42.788426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:42.884229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:42.885808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:42.979469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef8741-6404-45fb-8e4c-23134e4f1d7f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.029251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 53/109] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:43.038293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.040762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.041049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.044641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.047817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.057383 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:43.063315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:43.064211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:43.065005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 57/110] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:43.070347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.093360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.227800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61318699-e849-4727-b718-4da5e6718bf6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.234218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.305365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.306054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.306386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.306702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.308953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.310446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.312106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 54/111] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:43.319720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.328512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff47a4-25ab-4c50-9fb5-90c662c6fd22 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.403095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.403734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.404019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.404297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.404985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:43.405295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.406741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.427835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 58/112] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.434813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.478750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.489505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384cb5b-b7a7-438d-8a38-748485e6878a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.557124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.558164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.558750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.559212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.560253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] RBAC: Adding query filter params (role.id=5ff6eee575f04296a49a035f4b43e2bc, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=6ce01c7e327e4055af7fcf12bfb3f9f0) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:43.560781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.562536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b2df0-8542-48b4-b810-6597b0703b09 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.574615 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 55/113] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/role_assignments?user.id=6ce01c7e327e4055af7fcf12bfb3f9f0&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=5ff6eee575f04296a49a035f4b43e2bc => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.592186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117c03-5b39-405f-989a-0502e8973132 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.592762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117c03-5b39-405f-989a-0502e8973132 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.593318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11117c03-5b39-405f-989a-0502e8973132 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.595027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 56/114] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:43.600679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e9e9-29b1-4af8-a531-0c51ba1a5ee0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.601277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e9e9-29b1-4af8-a531-0c51ba1a5ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.601791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25e9e9-29b1-4af8-a531-0c51ba1a5ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.611389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e10fa1-74ef-47cc-92fe-4502340ddca0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.638159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:43.640379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2a25e9e9-29b1-4af8-a531-0c51ba1a5ee0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:43.641942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2a25e9e9-29b1-4af8-a531-0c51ba1a5ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:43.669202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.669893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.670248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.670527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.671722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.673244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.675789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 59/115] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:43.683291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.811216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 57/116] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:43.838214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f9ec-3318-4726-b03b-f78ee6ee2663 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:43.888983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:43.889638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.889948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.890230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.891440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:43.893057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:43.894633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcffb0-239b-4d5a-a463-adfacf00e178 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.895080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 60/117] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:43 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:43.895570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcffb0-239b-4d5a-a463-adfacf00e178 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.896046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcffb0-239b-4d5a-a463-adfacf00e178 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.897628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 58/118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:43.900312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:43.903037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643473-2edc-4219-aa0a-0c3df7f0602c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:43.903454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643473-2edc-4219-aa0a-0c3df7f0602c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:43.903864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643473-2edc-4219-aa0a-0c3df7f0602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:43.936782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-35643473-2edc-4219-aa0a-0c3df7f0602c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:43.938939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-35643473-2edc-4219-aa0a-0c3df7f0602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:43.959235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.017665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0edaab-fc1d-4041-ab58-347429ccf360 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.034679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 59/119] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:44.065984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564ea71-f0ea-48de-aedd-cf0878a0e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.066592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564ea71-f0ea-48de-aedd-cf0878a0e3bb None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.066882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564ea71-f0ea-48de-aedd-cf0878a0e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.067164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564ea71-f0ea-48de-aedd-cf0878a0e3bb None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/bda4269ce4624e36a0a082bab7f4df80/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.072023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564ea71-f0ea-48de-aedd-cf0878a0e3bb None admin] RBAC: Authorizing `identity:create_grant(project_id=8de9ed4401434e04a0f40cda66af4ddc, user_id=bda4269ce4624e36a0a082bab7f4df80, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.073496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564ea71-f0ea-48de-aedd-cf0878a0e3bb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.140784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 61/120] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:43 2022] PUT /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/bda4269ce4624e36a0a082bab7f4df80/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:44.221381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a89c-feeb-4083-924d-638de8f84af7 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.222068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a89c-feeb-4083-924d-638de8f84af7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.222555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a89c-feeb-4083-924d-638de8f84af7 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.224244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 60/121] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:44.231225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.231558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.231802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.255453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:44.257276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:44.343908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 62/122] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:44.359957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a89c-feeb-4083-924d-638de8f84af7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.391342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.516386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a89c-feeb-4083-924d-638de8f84af7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.538864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.552170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.552818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.553686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.554000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.564925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:44.570586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:44.571494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:44.572348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 61/123] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:44.577672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.614328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.667009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.689899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b7385-a5c2-43f2-b7e2-10e6c9f1e0c2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.714457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8bbe3-0ab6-4778-a1e0-b7327b941e9d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.741796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.741796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.741796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.742146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.742603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:44.742916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.744323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.770276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 62/124] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:44.776185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.778455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.779289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.779834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.786235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.803968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:44.814739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:44.815810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:44.816606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:44.818541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 63/125] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:44.824266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.935320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8c38-1be6-41a5-9a40-c70c9df884df None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.970798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:44.971445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:44.971731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:44.972010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:44.973265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:44.974775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:44.976964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 63/126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:44.977890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:44.986912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a30e-6a97-4a71-a944-38f8039a3178 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:44.990204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:44.996043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.042523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.043525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.044019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.044538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.045458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:45.046032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.047657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.071958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 64/127] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:45.073204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.114709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7383cd7-02b2-4cc4-8eac-eb0d4a011060 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.153272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.154900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.155337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.155643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.174503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:45.184614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:45.186414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 64/128] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:45.187984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.337230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e8a67-9570-46d5-997b-c7c574e386b4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.381729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.397753 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.399285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.400023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.400776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.402933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.405941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.409454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 65/129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.411121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.446250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cb1f2-b41f-439f-a361-57740a44ae84 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.498133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.508879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.509938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.510418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.510895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.512848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.515612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.518546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 65/130] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.519865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.594112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74921c51-509d-4171-bd7b-175b2a0df8e2 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.651871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.653045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.653628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.654272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.655525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:45.656186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.658787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.672882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 66/131] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.681832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.700188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b73ff1-8e64-4b20-80fc-3a2a9e230e47 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.759246 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.760371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.760961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.761442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/84b18f6adbc04f4f94e86ebc7dc7e8e2/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.764527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de9ed4401434e04a0f40cda66af4ddc, user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.767064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.819916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.828977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d201c42e-30d4-4541-a80c-d9be3584f2dc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:45.866244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c47717-190f-4a17-a90b-ce0519d8f6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:45.866900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c47717-190f-4a17-a90b-ce0519d8f6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.867189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c47717-190f-4a17-a90b-ce0519d8f6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.867471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c47717-190f-4a17-a90b-ce0519d8f6f6 None admin] PATH_INFO: `/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.868622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c47717-190f-4a17-a90b-ce0519d8f6f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d601b3b45a7e4bfc91a531f9f7143ea7)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:45.870184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c47717-190f-4a17-a90b-ce0519d8f6f6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:45.872084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 67/132] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:45.877021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193581-c2d8-439f-8691-e66c79f08b67 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:45.877021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193581-c2d8-439f-8691-e66c79f08b67 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:45.877021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37193581-c2d8-439f-8691-e66c79f08b67 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:45.877021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 68/133] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:45.877021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193581-c2d8-439f-8691-e66c79f08b67 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:45.895955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:45.909959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 66/134] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:45 2022] PUT /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/84b18f6adbc04f4f94e86ebc7dc7e8e2/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:45.909959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:46.076360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5498c7-4109-4d5f-91e8-27aef134c684 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.115181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37193581-c2d8-439f-8691-e66c79f08b67 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.134300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.135626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.136604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.137091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] PATH_INFO: `/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7/users/bda4269ce4624e36a0a082bab7f4df80/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.140134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] RBAC: Authorizing `identity:create_grant(project_id=d601b3b45a7e4bfc91a531f9f7143ea7, user_id=bda4269ce4624e36a0a082bab7f4df80, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.142181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.158318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76188e-e662-4a55-9b29-e591594b41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.159004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76188e-e662-4a55-9b29-e591594b41ae None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.159285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76188e-e662-4a55-9b29-e591594b41ae None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.159570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76188e-e662-4a55-9b29-e591594b41ae None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.160737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76188e-e662-4a55-9b29-e591594b41ae None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.162373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76188e-e662-4a55-9b29-e591594b41ae None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.164261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 69/135] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:45 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:46.165304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cf781-131c-49df-91e5-9b2d338cd0f4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.165599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cf781-131c-49df-91e5-9b2d338cd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.165910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cf781-131c-49df-91e5-9b2d338cd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.185340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8a5cf781-131c-49df-91e5-9b2d338cd0f4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:46.186591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8a5cf781-131c-49df-91e5-9b2d338cd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:46.211454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 67/136] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:45 2022] PUT /identity/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7/users/bda4269ce4624e36a0a082bab7f4df80/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:46.212361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:46.232663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:46.332387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 70/137] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:46.339701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:46.396690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1a291-da2a-415d-b22c-4ca06ee84552 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.408208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f653e5-c7c2-4d1a-b71c-af2f31615232 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.408512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f653e5-c7c2-4d1a-b71c-af2f31615232 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.408768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f653e5-c7c2-4d1a-b71c-af2f31615232 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.410185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 71/138] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:46.416316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.416602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.416883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.444397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:46.445658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:46.488793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.489540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.489851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.490135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.492754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.494264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.497217 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 68/139] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:46 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:46.504430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:46.585275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 72/140] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:46.634881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95823db4-89c6-4f98-90e7-33fda3a6fedf None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.674057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:46.682727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde06dd-335a-47bc-ae5e-744f2134d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.683404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde06dd-335a-47bc-ae5e-744f2134d26f None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.683689 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde06dd-335a-47bc-ae5e-744f2134d26f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.683970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde06dd-335a-47bc-ae5e-744f2134d26f None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/bda4269ce4624e36a0a082bab7f4df80/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.687554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde06dd-335a-47bc-ae5e-744f2134d26f None admin] RBAC: Authorizing `identity:create_grant(project_id=8de9ed4401434e04a0f40cda66af4ddc, user_id=bda4269ce4624e36a0a082bab7f4df80, role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.689026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde06dd-335a-47bc-ae5e-744f2134d26f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.780619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:46.786253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 69/141] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:46 2022] PUT /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/bda4269ce4624e36a0a082bab7f4df80/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:46.878395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445661-f774-4566-8861-efff805299a9 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.878745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445661-f774-4566-8861-efff805299a9 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.878923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445661-f774-4566-8861-efff805299a9 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.880791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 70/142] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:46.885970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.886302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.886540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.889037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:46.904382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c9ab1-b811-4857-b53c-fc962ebb93fc None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:46.926948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:46.928236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:46.959184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:46.961740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:46.962471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:46.964447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:46.966218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:46.969307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:46.974108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 73/143] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:46.992464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.111147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 71/144] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:47.128478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb87514-6069-44a5-8948-66b5a97f3bfc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.137796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.173792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.174884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.175369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.175866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.176785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.178602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.283783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863986-97bd-40f4-9e23-55bfb4300250 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.298276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 74/145] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:46 2022] POST /identity/v3/users => generated 283 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:25:47.304190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.330356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.331018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.331300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.331572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.348879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:47.353750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:47.354624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:47.355881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 72/146] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:47.360819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.386703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.505745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c27dd4-17fc-4ea7-9c0b-11afcbc77f72 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.542392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.543028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.543388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.543670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.544394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:47.544707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.546121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.549238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.557260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 75/147] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:47.566333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.685587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.697029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ae8f0-e348-4297-a10e-e89c0438c2e2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.718892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74233-013b-41f3-8018-2f9096f9af2a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.739054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.739714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.739999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.740377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.753072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:47.759927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:47.760809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:47.761644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:47.762365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 73/148] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:47.769980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.770291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.770638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.770928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.771206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] PATH_INFO: `/v3/users/6ce01c7e327e4055af7fcf12bfb3f9f0` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.772982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] RBAC: Authorizing `identity:get_user(user_id=6ce01c7e327e4055af7fcf12bfb3f9f0)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.774511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.776123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 76/149] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/users/6ce01c7e327e4055af7fcf12bfb3f9f0 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:47.785162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.875110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:47.897377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270b35-1b94-46e3-b539-e62b05253ac0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:47.935170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:47.936176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:47.936604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:47.937036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:47.938403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:47.939995 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:47.941810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 77/150] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:47.947971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:47.973330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.044134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682a08-de20-4fd1-8c24-e47b82aa1f91 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.061242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b88b585-6b49-4f1b-ad02-5e17d9c84abf None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.100796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.101601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.101930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.102211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/6ce01c7e327e4055af7fcf12bfb3f9f0/roles/5ff6eee575f04296a49a035f4b43e2bc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.104236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de9ed4401434e04a0f40cda66af4ddc, user_id=6ce01c7e327e4055af7fcf12bfb3f9f0, role_id=5ff6eee575f04296a49a035f4b43e2bc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.105709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.116799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.118459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.118459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.118459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.118813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:48.119125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.120710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.131497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 74/151] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:48.137190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.179515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 78/152] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:47 2022] PUT /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/users/6ce01c7e327e4055af7fcf12bfb3f9f0/roles/5ff6eee575f04296a49a035f4b43e2bc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:25:48.267893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.272400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd0eed-b3f7-4a61-aa9e-fbc4c6c7263c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.311874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.312531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.312814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.313089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.318709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.320219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.322321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 75/153] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:48.327719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.438355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.472529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07932677-bcfd-425b-85dd-f822825de202 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.515496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.516122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.516407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.516687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.613222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.614770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.704780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:48.742059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 79/154] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:48.748042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:48.876803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68733e9-655f-468a-95c5-05fbed0469ce None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:48.918672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ebe09-3707-4cea-9d40-65f0fee13727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:48.919321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebe09-3707-4cea-9d40-65f0fee13727 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:48.919600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebe09-3707-4cea-9d40-65f0fee13727 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:48.919874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebe09-3707-4cea-9d40-65f0fee13727 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:48.921046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ebe09-3707-4cea-9d40-65f0fee13727 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:48.922539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ebe09-3707-4cea-9d40-65f0fee13727 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:48.924354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 76/155] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:48.930197 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.038726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53747c-10ee-4a28-8b61-d14b426bd1c8 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.051120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec68be1-3fe0-4a2e-a960-692063984fdf None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.051391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec68be1-3fe0-4a2e-a960-692063984fdf None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.051663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec68be1-3fe0-4a2e-a960-692063984fdf None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.053171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 77/156] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:49.063293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.063590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.063834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.090409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:49.091652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:49.102494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.103125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.103410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.103685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.104588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=bda4269ce4624e36a0a082bab7f4df80) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:49.104908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.106413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.121695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 80/157] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:48 2022] GET /identity/v3/role_assignments?user.id=bda4269ce4624e36a0a082bab7f4df80&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=9386846542804a8b96776ed9753a7628 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:49.134006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.192638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 78/158] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:49.477007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.526810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.610484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e213-c6a5-4d25-9fc5-750146ac4f5e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.648110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c266721-3b95-44ed-bc58-e9bd7e26f47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.648754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266721-3b95-44ed-bc58-e9bd7e26f47a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.649037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266721-3b95-44ed-bc58-e9bd7e26f47a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.649312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c266721-3b95-44ed-bc58-e9bd7e26f47a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.664430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c266721-3b95-44ed-bc58-e9bd7e26f47a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4c266721-3b95-44ed-bc58-e9bd7e26f47a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:49.669690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:49.670613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:49.671453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 81/159] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:49.679440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.743721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c41c47-64f3-4b42-85eb-4b5b1303ccc6 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.744084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c41c47-64f3-4b42-85eb-4b5b1303ccc6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.744194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c41c47-64f3-4b42-85eb-4b5b1303ccc6 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.745639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 82/160] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:49.751221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.751516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.751778 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.786817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:49.788098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:49.808986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7311e-7587-49c7-9af8-6628f348b288 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:49.859885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:49.860865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:49.861356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:49.861867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:49.862871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:49.863669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:49.866020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:49.877098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 79/161] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:49.884856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:49.939738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:49.941092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 83/162] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:50.027318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ef231-137b-4edb-866d-1946bcf95277 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.064502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.065154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.065435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.065711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] PATH_INFO: `/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.066957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=84b18f6adbc04f4f94e86ebc7dc7e8e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.068917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.070781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 80/163] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:49 2022] GET /identity/v3/users/84b18f6adbc04f4f94e86ebc7dc7e8e2 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:50.076341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.106694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.186467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e33567-878a-44ce-86c4-274215e447b4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.222234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.222864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.223147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.223426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.295923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.297408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.322530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.402457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 84/164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:50.408070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.532297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.540588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936fa8c9-552a-41ab-8c82-88f5dfa2d8a5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.589262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.589847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.590134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.590410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.591550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.593073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.594764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 81/165] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:50.600974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.613327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.745183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d31d7a-a39f-4f21-a50b-e0b167b01427 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.782390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.783073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.783362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.783639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.784389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:50.784702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:50.786262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7525f-fb51-413a-a8bf-000059ba4fd0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:50.794173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:50.797092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 85/166] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/role_assignments?user.id=84b18f6adbc04f4f94e86ebc7dc7e8e2&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:50.826821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b9e2c6-e7b8-4df8-91fd-43b3e5807541 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:50.883256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:50.884256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.884747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.885225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.897609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de206-91dd-46ad-bb71-830f24bbd34b None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.897987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de206-91dd-46ad-bb71-830f24bbd34b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.898190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de206-91dd-46ad-bb71-830f24bbd34b None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.899837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 86/167] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:50.905894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:50.906191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:50.906451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:50.908435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:50.917037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:50.918241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:50.919074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:50.921597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 82/168] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:50.926226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:50.927446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:50.928355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:50.994157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.063947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 87/169] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:51.076963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3223e1-afac-405e-9872-4dacfa6d9874 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.116990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.117789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.118177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.118549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.119327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:51.119636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.121028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bea1f-f5d6-42bd-8917-56756570ee1c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.130449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 83/170] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:51.138466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.154353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf07f2-09e0-47b3-b405-22075422b929 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.154658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf07f2-09e0-47b3-b405-22075422b929 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.154981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf07f2-09e0-47b3-b405-22075422b929 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.156329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 84/171] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:51.161979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.162331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.162573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.182115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:51.183422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:51.259864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 85/172] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:51.330395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f546dd7-728b-448d-bf03-ea5c5ceea389 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.355107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.378789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.379437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.379717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.379988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.381693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.383183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.385254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 88/173] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:51.395178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.422936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.482994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.553460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4338136-d93d-40df-a0e2-6caf5cbe66ac None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.601598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebc954-1768-450d-b57b-8d8979609ced None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.617586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.618240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.618737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.619239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.640094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.641660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.641660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.641660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.653537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:51.658654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:51.659746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:51.660797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:51.663330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 89/174] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:25:51.669138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.734379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.779419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918022d-d46e-4d5a-8ae1-bbb248feb853 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.780286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.782628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.811746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.818921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.819538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.819822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.820095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:51.820774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:51.821081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:51.822613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:51.831780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 90/175] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:51.832640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:51.949596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c0829-7a0b-4684-9c03-0c5dd07cee9a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:51.959527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:51.987400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:51.988046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:51.988330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:51.988668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.000959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:52.006821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:52.007723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:52.008548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 91/176] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:52.009225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.012864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 86/177] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:52.018150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.118464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058d500-f1c4-4d70-b5d0-7b5e3772110f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.155979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.156677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.156959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.157233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] PATH_INFO: `/v3/users/bda4269ce4624e36a0a082bab7f4df80` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.158453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] RBAC: Authorizing `identity:get_user(user_id=bda4269ce4624e36a0a082bab7f4df80)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.159957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.162058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 92/178] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/users/bda4269ce4624e36a0a082bab7f4df80 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.163361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.191181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00f0d2-41b8-46e9-913c-a117274813f6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.208580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.210109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.232006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.233016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.233515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.234034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.234918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.235496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.237094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb820f3d-ce90-4b07-bfd9-843f7ade5f20 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.246837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 87/179] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:52.248423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce55bd-5f5a-47e0-9391-3b84b298a815 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.248918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce55bd-5f5a-47e0-9391-3b84b298a815 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.249398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce55bd-5f5a-47e0-9391-3b84b298a815 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.255505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 88/180] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:52.258274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce55bd-5f5a-47e0-9391-3b84b298a815 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.281818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde108a-3eb3-4817-991a-62abada104b6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.321568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.321966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.322159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.322454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] PATH_INFO: `/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.323734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] RBAC: Authorizing `identity:get_project(project_id=d601b3b45a7e4bfc91a531f9f7143ea7)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.325184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.327356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 93/181] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/projects/d601b3b45a7e4bfc91a531f9f7143ea7 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.328013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.380585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce55bd-5f5a-47e0-9391-3b84b298a815 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.417664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5d396-41cb-49f5-a948-5ec222fa6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.418344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5d396-41cb-49f5-a948-5ec222fa6477 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.418606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5d396-41cb-49f5-a948-5ec222fa6477 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.418882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5d396-41cb-49f5-a948-5ec222fa6477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.436318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d111c6c-8c81-4937-97e7-94f23543363b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.439531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.469160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.482206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12309f-a487-443a-be47-cfba5370684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.482830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12309f-a487-443a-be47-cfba5370684f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.483110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12309f-a487-443a-be47-cfba5370684f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.483385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12309f-a487-443a-be47-cfba5370684f None admin] PATH_INFO: `/v3/users/b206eac7936e414d925e0e9f48d279a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.492623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5d396-41cb-49f5-a948-5ec222fa6477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.494146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5d396-41cb-49f5-a948-5ec222fa6477 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.499520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12309f-a487-443a-be47-cfba5370684f None admin] RBAC: Authorizing `identity:get_user(user_id=b206eac7936e414d925e0e9f48d279a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.500976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12309f-a487-443a-be47-cfba5370684f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.502676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 94/182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/users/b206eac7936e414d925e0e9f48d279a5 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.503841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.504128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.504400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.522032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:52.523271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.593057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 95/183] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:52.599427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.616549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 89/184] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:52.618943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507736-a2c7-4281-a1f0-3d1b4eeac5e3 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.619424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507736-a2c7-4281-a1f0-3d1b4eeac5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.619867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98507736-a2c7-4281-a1f0-3d1b4eeac5e3 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.621932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 90/185] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:52.623338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ddc3-3921-48b5-8dfd-495a3b0c6282 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.623809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ddc3-3921-48b5-8dfd-495a3b0c6282 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.624257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ddc3-3921-48b5-8dfd-495a3b0c6282 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.625627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 91/186] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:52.630623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5ddc3-3921-48b5-8dfd-495a3b0c6282 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.705144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.715009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8a8a-fce1-45a1-9a70-280254f0a7c5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.717372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.746095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5ddc3-3921-48b5-8dfd-495a3b0c6282 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.751483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.752111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.752379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.752689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.753388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, scope.project.id=d601b3b45a7e4bfc91a531f9f7143ea7, user.id=bda4269ce4624e36a0a082bab7f4df80) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:52.754168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.758800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.762240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 96/187] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/role_assignments?user.id=bda4269ce4624e36a0a082bab7f4df80&scope.project.id=d601b3b45a7e4bfc91a531f9f7143ea7&role.id=9386846542804a8b96776ed9753a7628 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.763363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:52.805225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeeac4-b75a-48b2-a989-3001e09a1acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.805895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeeac4-b75a-48b2-a989-3001e09a1acf None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.806224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeeac4-b75a-48b2-a989-3001e09a1acf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.806502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeeac4-b75a-48b2-a989-3001e09a1acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.896106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeeac4-b75a-48b2-a989-3001e09a1acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.898197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeeac4-b75a-48b2-a989-3001e09a1acf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.898398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc1224-2ac9-403e-9b53-9c92d687ecf5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:52.942547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0be798-dc3a-4e46-8500-c00772e5614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:52.943225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0be798-dc3a-4e46-8500-c00772e5614d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.943507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0be798-dc3a-4e46-8500-c00772e5614d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.943779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0be798-dc3a-4e46-8500-c00772e5614d None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.944926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0be798-dc3a-4e46-8500-c00772e5614d None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:52.946463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0be798-dc3a-4e46-8500-c00772e5614d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:52.948785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 97/188] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:52.949250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:52.949534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:52.954009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:52.973510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:52.975320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:52.991430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:52.996326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.014958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 92/189] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:53.019071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.019469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.019676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.039102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:53.040460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:53.049169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 98/190] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:53.050134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.118042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 93/191] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:53.119218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.171223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ae9fc-b2b6-4712-97d8-bf4d71cd426c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.220999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.222049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.222529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.222998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.234271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:53.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:53.240432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:25:53.241285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:53.243583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 99/192] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:53.244638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.249029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14210203-c3a0-49fd-8de0-2318efe8ef90 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.259239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.263220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.295106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.295737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.296018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.296299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.297202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] RBAC: Adding query filter params (role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=bda4269ce4624e36a0a082bab7f4df80) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.297515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.299677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.309534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 94/193] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/role_assignments?user.id=bda4269ce4624e36a0a082bab7f4df80&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.315219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.383908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196ae98-6bb9-4287-b8fc-e1159b951d2c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.430047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.430704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.431018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.431242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.432446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.433979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.440477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 100/194] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.440477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.448393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d61b38-f9bb-4eb9-a56b-02e9d902312a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.492861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.493874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.494158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.494578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.495252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.495560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.496925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.505717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 95/195] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.507620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.542981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.543618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.562766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c072f9-59eb-47d8-85e5-9303bbaa12f1 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.600178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.600813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.601091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.601357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.602471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.603918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.605689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 101/196] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.610735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.616023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22688548-00da-4682-89f6-a744c0b69bc6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.649360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.650024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.650305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.650594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.660543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:53.665232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:53.666133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:53.666955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 96/197] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:53.667619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.713524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc02e5-a598-4eae-86e6-22170bea773d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.746800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.747405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.747682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.747954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.748682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=b206eac7936e414d925e0e9f48d279a5) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.748989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.750949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.756164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 102/198] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/role_assignments?user.id=b206eac7936e414d925e0e9f48d279a5&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.756884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.771923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.776691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:53.782693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496c17b-3113-48aa-8ae7-22f4d0e822c8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.822547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.823201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.823479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.823751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] PATH_INFO: `/v3/users/6ce01c7e327e4055af7fcf12bfb3f9f0` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.824958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] RBAC: Authorizing `identity:get_user(user_id=6ce01c7e327e4055af7fcf12bfb3f9f0)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.826481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.828303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 97/199] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/users/6ce01c7e327e4055af7fcf12bfb3f9f0 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:53.830730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:53.888336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e924632-4b14-4dda-a2d2-b96646f8ec37 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.929868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.930585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.930878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.931162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.931806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.933256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:53.953320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd34407-68e5-425f-b6a4-66624d0f00e3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:53.989178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:53.989796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:53.990677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:53.990945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:53.991609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:53.991914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:53.993431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.001434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 98/200] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:54.002276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.029040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.040619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 103/201] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:53 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:54.050910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.123398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0eae31-3d58-4998-9ffb-7aca0abe33b0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.178459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.179336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.179789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.180401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.184944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.233414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f2bd-368d-4037-8fd0-5b5dd65e411a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.273016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.273217 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.273657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.273965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.274236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] PATH_INFO: `/v3/users/b206eac7936e414d925e0e9f48d279a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.274565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.275382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] RBAC: Authorizing `identity:get_user(user_id=b206eac7936e414d925e0e9f48d279a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.276879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.278660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 104/202] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/users/b206eac7936e414d925e0e9f48d279a5 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:54.284850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.307704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.402947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 99/203] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:54.408319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.415149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192e9cc-84c2-4cb0-b715-c0941bf33707 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.456783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.456783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.456783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.457121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.468191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.535090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957b249-2ae4-4fef-a23a-fe2ea6820e16 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.538572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.540155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.565156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.581918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.582562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.583085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.583366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.587988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.589467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.591197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 100/204] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:54.597843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.670069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 105/205] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:25:54.671811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.714118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3758d7-a293-4b27-8973-777ad7a400d8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.718479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:54.751401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.752018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.752296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.752565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.753739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] RBAC: Adding query filter params (role.id=5ff6eee575f04296a49a035f4b43e2bc, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc, user.id=6ce01c7e327e4055af7fcf12bfb3f9f0) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:54.753739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.756297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.769526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 101/206] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/role_assignments?user.id=6ce01c7e327e4055af7fcf12bfb3f9f0&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=5ff6eee575f04296a49a035f4b43e2bc => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:54.795567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486bda-1f83-458b-ba4f-fa872916c20c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:54.857352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e056d56-e9ec-4449-9745-72369c970dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:54.858063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056d56-e9ec-4449-9745-72369c970dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:54.858348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056d56-e9ec-4449-9745-72369c970dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:54.858624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e056d56-e9ec-4449-9745-72369c970dc8 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:54.859944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e056d56-e9ec-4449-9745-72369c970dc8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:54.861651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e056d56-e9ec-4449-9745-72369c970dc8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:54.863874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 106/207] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:54.869878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:54.940520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:55.003130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c13fb-4ec6-4ba4-9e90-c2b8ba50516c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:55.039258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:55.039878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.040163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.040438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.041178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] RBAC: Adding query filter params (role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=b206eac7936e414d925e0e9f48d279a5) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:55.041487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:55.042982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f597d-2047-403d-8c99-01bedc36a269 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:55.048820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 102/208] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:54 2022] GET /identity/v3/role_assignments?user.id=b206eac7936e414d925e0e9f48d279a5&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:55.822948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117479d-1a1d-4bd2-a6c2-e44344d83365 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.823518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117479d-1a1d-4bd2-a6c2-e44344d83365 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.823518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117479d-1a1d-4bd2-a6c2-e44344d83365 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.824897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 107/209] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:55.830723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:55.831718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:55.832221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:55.851976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:55.853539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:55.930567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 103/210] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:56.207170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117479d-1a1d-4bd2-a6c2-e44344d83365 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.319655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117479d-1a1d-4bd2-a6c2-e44344d83365 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.327440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.355808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcdd9-626b-4578-8771-6eab01e736c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.356448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcdd9-626b-4578-8771-6eab01e736c6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.356731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcdd9-626b-4578-8771-6eab01e736c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.357007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcdd9-626b-4578-8771-6eab01e736c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.367943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edcdd9-626b-4578-8771-6eab01e736c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-e2edcdd9-626b-4578-8771-6eab01e736c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:56.374315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:56.375252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:56.376060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 108/211] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:56.381891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.425688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0a22-1032-4fb8-9ead-259ee6f14cc2 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.426024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0a22-1032-4fb8-9ead-259ee6f14cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.426289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c0a22-1032-4fb8-9ead-259ee6f14cc2 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.428304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 109/212] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:56.433420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.433707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.434012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.439614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.452741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:56.454059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.499723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954839b2-d9a0-41bc-8743-0ed228703946 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.526757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 110/213] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:56.544945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.545574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.545927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.546209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.546890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:56.547245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.548674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6992e-83e6-4d0c-acb4-7eaa6567a84f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.558615 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 104/214] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:56.564306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.664874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.670842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816295af-87d8-4e40-bb2e-bc53580656e5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.707414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.708056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.708337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.708644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] PATH_INFO: `/v3/users/b206eac7936e414d925e0e9f48d279a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.709887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] RBAC: Authorizing `identity:get_user(user_id=b206eac7936e414d925e0e9f48d279a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.711749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.713114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d562230-f0ff-42b3-a76e-55511fe1ff06 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.713627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d562230-f0ff-42b3-a76e-55511fe1ff06 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.713883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 111/215] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/users/b206eac7936e414d925e0e9f48d279a5 => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:56.714341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d562230-f0ff-42b3-a76e-55511fe1ff06 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.716113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 105/216] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:25:56.719328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.721734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.722295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.722771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.742222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:56.743859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:56.823375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 106/217] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:25:56.829999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.839936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00a80c-afcf-4982-9d34-226b525ab797 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.881900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.883112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.883763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.884362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:56.884648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:56.886117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:56.888313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:56.890603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 112/218] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:56.899226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:56.940504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:56.959372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9d80-0d3d-418e-833f-d3c8da55eb0a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:56.998011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:56.999049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:56.999553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.000028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.011531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:57.016829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:57.017874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:25:57.018709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:25:57.019360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d43b62-d941-4f04-a505-d20a86b0c50c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.021483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 107/219] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:25:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:57.027503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.055560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763e3f0-524c-41a4-866a-70ec62a2de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.056239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e3f0-524c-41a4-866a-70ec62a2de5d None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.056522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e3f0-524c-41a4-866a-70ec62a2de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.056853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e3f0-524c-41a4-866a-70ec62a2de5d None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411/users/b206eac7936e414d925e0e9f48d279a5/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.058777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e3f0-524c-41a4-866a-70ec62a2de5d None admin] RBAC: Authorizing `identity:create_grant(project_id=b8101feb5c7e451b867c922095e58411, user_id=b206eac7936e414d925e0e9f48d279a5, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.060217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e3f0-524c-41a4-866a-70ec62a2de5d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.131204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.134259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e6308-f112-4076-8c37-6222132eac0e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.148052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 113/220] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:56 2022] PUT /identity/v3/projects/b8101feb5c7e451b867c922095e58411/users/b206eac7936e414d925e0e9f48d279a5/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:57.149359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc026-0f36-46da-a276-33ed088620f3 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.149647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc026-0f36-46da-a276-33ed088620f3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.149941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bc026-0f36-46da-a276-33ed088620f3 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.151212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 114/221] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:57.154437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc026-0f36-46da-a276-33ed088620f3 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.174116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.174849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.175128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.175403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.176159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:57.176480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.178004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa173e-e8c6-421a-9b1b-eaeb8f1dff8c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.187739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 108/222] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:57.189247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.189492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.189805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.210329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:57.211756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:57.272938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.285203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9bc026-0f36-46da-a276-33ed088620f3 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.313842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 109/223] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:57.316477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.352188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.352840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.353122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.353392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.354545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.355991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.357910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 115/224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.364039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.439832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.451547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf82e7-92fb-47ce-becf-63a5c30768b3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.501153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.502226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.502730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.503199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] PATH_INFO: `/v3/users/93c360b9cc6e4f9a90ae98ef7af689bd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.519361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] RBAC: Authorizing `identity:get_user(user_id=93c360b9cc6e4f9a90ae98ef7af689bd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.522540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.524635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 110/225] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/users/93c360b9cc6e4f9a90ae98ef7af689bd => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:57.530802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.583521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fa0e1-860c-4052-8915-125570c2961e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.627026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.628257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.628738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.629226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.630262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.637209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.664032 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00591051-cd12-4c95-be63-e48d20941c9c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.700630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.701270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.701621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.701934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.722658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.753473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 116/226] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:25:57 2022] POST /identity/v3/users => generated 297 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:25:57.756276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.788884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:57.811959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:57.815614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:57.913591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb526-2e65-4060-800e-de76c3879101 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:57.954700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:57.955388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:57.955674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:57.955951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:57.961075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 111/227] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:25:57.966939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:57.975871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:25:57.982938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:25:57.983864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:25:57.984676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:25:57.987071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 117/228] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:25:57.993887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.036183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.088395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.116232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a83c60-2c0d-458c-af2a-3d3b49bd57be None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.157110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.157735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.158055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.158452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.159201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:58.159579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.161001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.171017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 118/229] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:58.177997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.188685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6388af-c298-4821-82e2-dcfd2831f965 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.282661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.283307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.283585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.283855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.285170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.288155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.290420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 112/230] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:57 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:58.296100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.320099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b735d-626e-4165-980c-a0fcdf7bcffa None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.357278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.357861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.358149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.358424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] PATH_INFO: `/v3/users/b206eac7936e414d925e0e9f48d279a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.359703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=b206eac7936e414d925e0e9f48d279a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.361160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.363137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 119/231] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:25:58 2022] GET /identity/v3/users/b206eac7936e414d925e0e9f48d279a5 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:25:58.370921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.400302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.427784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da908981-0c4f-4f54-9221-3034e26f9e2d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.446311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:58.464211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.464833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.465161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.465434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.466197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=93c360b9cc6e4f9a90ae98ef7af689bd) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:25:58.466505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.467963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.474131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 113/232] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:25:58 2022] GET /identity/v3/role_assignments?user.id=93c360b9cc6e4f9a90ae98ef7af689bd&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=9386846542804a8b96776ed9753a7628 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:58.521448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4fe9b-4bcc-4343-9818-d1f8af2f2dd6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.560545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4b7bc-9fb4-441e-8510-6bf8a64a2a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.561588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4b7bc-9fb4-441e-8510-6bf8a64a2a1c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.562109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4b7bc-9fb4-441e-8510-6bf8a64a2a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.562592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4b7bc-9fb4-441e-8510-6bf8a64a2a1c None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.564064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4b7bc-9fb4-441e-8510-6bf8a64a2a1c None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.565735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4b7bc-9fb4-441e-8510-6bf8a64a2a1c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.568521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 120/233] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:25:58 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:25:58.574381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:58.700387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db627a-3524-40e1-bfb5-ce29a66c3db7 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:25:58.735190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa892e71-0687-4873-a893-54893a6572f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:25:58.735857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892e71-0687-4873-a893-54893a6572f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:58.736134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892e71-0687-4873-a893-54893a6572f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:58.736404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa892e71-0687-4873-a893-54893a6572f7 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411/users/b206eac7936e414d925e0e9f48d279a5/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:58.738618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892e71-0687-4873-a893-54893a6572f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8101feb5c7e451b867c922095e58411, user_id=b206eac7936e414d925e0e9f48d279a5, role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:25:58.740613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa892e71-0687-4873-a893-54893a6572f7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:25:58.831314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 114/234] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:25:58 2022] PUT /identity/v3/projects/b8101feb5c7e451b867c922095e58411/users/b206eac7936e414d925e0e9f48d279a5/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:25:59.355599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e497d8f-923d-4876-8b42-da6e42486409 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.356735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e497d8f-923d-4876-8b42-da6e42486409 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.357237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e497d8f-923d-4876-8b42-da6e42486409 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.359182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 121/235] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:25:59.365021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:25:59.366008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:25:59.366485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:25:59.390493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:25:59.392033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:25:59.438272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:25:59.482777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 115/236] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:25:59.869706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e497d8f-923d-4876-8b42-da6e42486409 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:25:59.985411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.016161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e497d8f-923d-4876-8b42-da6e42486409 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.050994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.051688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.051999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.052285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.068822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:00.074038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:00.074931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:00.076112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 122/237] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:00.082787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.216945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b9fec-6ca0-429f-be27-d683e8cdf868 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.274721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.275459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.275738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.276013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.276685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:00.276990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.282487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf77fd-392f-43fc-b09d-8a203ee70b17 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.292738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 116/238] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.298974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.358463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348258-2bb9-41fd-ada6-d33244b8ebd9 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.358783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348258-2bb9-41fd-ada6-d33244b8ebd9 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.359018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f348258-2bb9-41fd-ada6-d33244b8ebd9 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.360365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 117/239] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:00.369605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ab79-14f9-40d6-9ad0-fff46e84a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.370247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ab79-14f9-40d6-9ad0-fff46e84a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.370247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03ab79-14f9-40d6-9ad0-fff46e84a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.396605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-1a03ab79-14f9-40d6-9ad0-fff46e84a9f1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:00.398157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1a03ab79-14f9-40d6-9ad0-fff46e84a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:00.435179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.436138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d310a-1cac-4ca6-a8a0-09d40faff1f1 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.472703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1b4f2-baf1-4e54-bec3-6a21ae7ef28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.473267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b4f2-baf1-4e54-bec3-6a21ae7ef28f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.473552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b4f2-baf1-4e54-bec3-6a21ae7ef28f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.473880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b4f2-baf1-4e54-bec3-6a21ae7ef28f None admin] PATH_INFO: `/v3/users/b206eac7936e414d925e0e9f48d279a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.475284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1b4f2-baf1-4e54-bec3-6a21ae7ef28f None admin] RBAC: Authorizing `identity:get_user(user_id=b206eac7936e414d925e0e9f48d279a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.476749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1b4f2-baf1-4e54-bec3-6a21ae7ef28f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.478386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 123/240] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/users/b206eac7936e414d925e0e9f48d279a5 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:00.479542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ae2ae-318e-423b-ad02-646d226d6e5d None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.479835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ae2ae-318e-423b-ad02-646d226d6e5d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.480111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ae2ae-318e-423b-ad02-646d226d6e5d None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.481331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 124/241] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:00.486415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ae2ae-318e-423b-ad02-646d226d6e5d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.489363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.494060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 118/242] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:00.495743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.496227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.496663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.529896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:00.533458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:00.622003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ae2ae-318e-423b-ad02-646d226d6e5d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:00.669225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:00.670237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:00.670722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:00.671224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:00.689346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 119/243] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:00.761572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:00.763083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:00.765075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.888757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.895737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 125/244] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:00.901416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:00.993368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:00.999992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cb822-8425-499d-8a8e-372ca50a889d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.014953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef8d9-02cf-4e57-a7f8-d9d77f624b5e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.018091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.050700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.052473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.052930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.053273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.056424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52876ec9-6523-4294-8fb1-6969731ec11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.057175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52876ec9-6523-4294-8fb1-6969731ec11a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.057560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52876ec9-6523-4294-8fb1-6969731ec11a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.058003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52876ec9-6523-4294-8fb1-6969731ec11a None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.059252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52876ec9-6523-4294-8fb1-6969731ec11a None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.061343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52876ec9-6523-4294-8fb1-6969731ec11a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.065015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:01.068566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 126/245] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:01.069917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba856c-c37f-4b3d-aedb-042c307e7b1a None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.070210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba856c-c37f-4b3d-aedb-042c307e7b1a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.070600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba856c-c37f-4b3d-aedb-042c307e7b1a None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:01.070716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:01.071546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:01.072368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 120/246] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:01.073519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 127/247] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:01.077445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.079495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba856c-c37f-4b3d-aedb-042c307e7b1a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.189109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba856c-c37f-4b3d-aedb-042c307e7b1a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.196304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114845c-2aaf-4c6c-be84-8171ce3084a4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.225477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.226122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.226405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.226679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.227355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:01.227662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.229046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaedfe0-0fbf-4059-a266-7a69d065642f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.235272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.236086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.236513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.236928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.237438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 128/248] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:01.238017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=b206eac7936e414d925e0e9f48d279a5) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:01.238469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.240630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.243889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.244188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.244473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.247750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 121/249] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/role_assignments?user.id=b206eac7936e414d925e0e9f48d279a5&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:01.248843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.275764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:01.276938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:01.287470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.312053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.361488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 129/250] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:01.362806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.397886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2052b-83f1-4636-89df-beaac44853f9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.446721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa00c5a-6e82-49c7-9bb1-4bcd285604d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.447877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00c5a-6e82-49c7-9bb1-4bcd285604d5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.449332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00c5a-6e82-49c7-9bb1-4bcd285604d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.449870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa00c5a-6e82-49c7-9bb1-4bcd285604d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.451263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa00c5a-6e82-49c7-9bb1-4bcd285604d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.453433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa00c5a-6e82-49c7-9bb1-4bcd285604d5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.455642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 122/251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:01.457154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d51e9a-eb47-472f-b4af-36065532ad81 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.457706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d51e9a-eb47-472f-b4af-36065532ad81 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.458316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d51e9a-eb47-472f-b4af-36065532ad81 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.459831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 123/252] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:01.464872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d51e9a-eb47-472f-b4af-36065532ad81 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.504149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7908f-b2bd-4c79-9b4e-83b6b847da14 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.547078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f385cfc-77c4-483e-a615-15f7c635a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.547733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f385cfc-77c4-483e-a615-15f7c635a821 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.548015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f385cfc-77c4-483e-a615-15f7c635a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.548345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f385cfc-77c4-483e-a615-15f7c635a821 None admin] PATH_INFO: `/v3/users/f4809d3119314abf8f7307412ce1614b` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.563837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f385cfc-77c4-483e-a615-15f7c635a821 None admin] RBAC: Authorizing `identity:get_user(user_id=f4809d3119314abf8f7307412ce1614b)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.565303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f385cfc-77c4-483e-a615-15f7c635a821 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.567011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 130/253] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/users/f4809d3119314abf8f7307412ce1614b => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:01.568198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.568478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.568877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.572541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.586359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:01.587812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:01.593690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d51e9a-eb47-472f-b4af-36065532ad81 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.603618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.636547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.637454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.637795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.638176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.638846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.640410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:01.673697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 131/254] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:01.674628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.730325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 124/255] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:01 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:01.731415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.808407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6579f45-1f7f-49d7-b74c-03351a28d846 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.860221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.861514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.862282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.862659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.872207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a12b-d600-4dd2-bb9c-4579a286ea1f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:01.894518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.913960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:01.914940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:01.915401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:01.915855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:01.930934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:01.937829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:01.938994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:01.939892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:01.942212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 125/256] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:01.948411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:01.951983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:01.972655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:01.979145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.084929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429cec-1bc5-4d1c-af46-68b3dfcb7466 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.113849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 132/257] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:02.114841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.133550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.134228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.134823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.135102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.150742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:02.157803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:02.158759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:02.159987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 126/258] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:02.160665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.174099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.232970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.245715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1ff34-d7dd-4143-8711-72051ae45b7e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.281323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867bf8-cab3-4aac-b442-77f95d774b4f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.292720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.293345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.293626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.293930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.295096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:02.295401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.297363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.309731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 133/259] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.310591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.326935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.327626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.327953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.328226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.329375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.330911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.332597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 127/260] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.333445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.450318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6cf5e-0f22-40cc-9a99-083236c13dba None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.454541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2d3e3-ce59-4468-9fd2-b67c13b36210 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.470515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.486702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.494492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.495257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.495544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.495970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] PATH_INFO: `/v3/users/93c360b9cc6e4f9a90ae98ef7af689bd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.497632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=93c360b9cc6e4f9a90ae98ef7af689bd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.499751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.501720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.501971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 128/261] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/users/93c360b9cc6e4f9a90ae98ef7af689bd => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.502825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.506902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.507356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.507654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.509897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:02.510326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.511887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.521098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 134/262] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.522243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.634703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd4009-c3a2-4429-a6f2-c1dd3eb6b891 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.635362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c5f93-90b6-4ebb-a3ea-5a3a92cd8cb2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.675762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.676494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.676622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.677027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.677146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.677400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.677502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.677674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.678538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] RBAC: Adding query filter params (role.id=5ff6eee575f04296a49a035f4b43e2bc, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=f4809d3119314abf8f7307412ce1614b) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:02.678850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.679121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.680287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.680782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.687540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 135/264] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.688537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.692667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 129/264] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/role_assignments?user.id=f4809d3119314abf8f7307412ce1614b&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=5ff6eee575f04296a49a035f4b43e2bc => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.694691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:02.770253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.772400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:02.847400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46763ab9-0d66-449b-bd0b-7a775f2543dd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.875759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ca8d2-8e9f-4ad2-b4fa-b5cea97f1237 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:02.918224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.919243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.919349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:02.919884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:02.919990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.920165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:02.920438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] PATH_INFO: `/v3/users/b206eac7936e414d925e0e9f48d279a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.920840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411/users/93c360b9cc6e4f9a90ae98ef7af689bd/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:02.921567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] RBAC: Authorizing `identity:get_user(user_id=b206eac7936e414d925e0e9f48d279a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.923261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.923583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] RBAC: Authorizing `identity:create_grant(project_id=b8101feb5c7e451b867c922095e58411, user_id=93c360b9cc6e4f9a90ae98ef7af689bd, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:02.929530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 136/265] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/users/b206eac7936e414d925e0e9f48d279a5 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:02.930060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:02.933708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.024338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 130/266] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:02 2022] PUT /identity/v3/projects/b8101feb5c7e451b867c922095e58411/users/93c360b9cc6e4f9a90ae98ef7af689bd/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:03.058246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce521862-f11b-496a-9a75-040d2d8751d8 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.077800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.111246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.112171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.112603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.113025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.208132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.209639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.350027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 137/267] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:03.355659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.495242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e1550-2fc8-4968-bb3f-50f6cad1a32e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.528524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.543416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbb8b5-3111-4b3b-b662-65089489dbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.545091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbb8b5-3111-4b3b-b662-65089489dbbb None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.545091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbb8b5-3111-4b3b-b662-65089489dbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.545091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbb8b5-3111-4b3b-b662-65089489dbbb None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.545726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbb8b5-3111-4b3b-b662-65089489dbbb None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.547208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bbb8b5-3111-4b3b-b662-65089489dbbb None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.549130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 131/268] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:03 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:03.555601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:03.574067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:03.699649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9e040-c2a8-49ed-98e4-3608c9bf04ec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:03.743617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:03.744233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:03.744512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:03.744781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:03.745511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] RBAC: Adding query filter params (role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=b206eac7936e414d925e0e9f48d279a5) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:03.745836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:03.747347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6e919-ef15-4549-b7eb-123a1ce1d432 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:03.759307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 138/269] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:03 2022] GET /identity/v3/role_assignments?user.id=b206eac7936e414d925e0e9f48d279a5&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.123656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef961a2-44cc-4a6e-a03f-2dc364fe919c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.124020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef961a2-44cc-4a6e-a03f-2dc364fe919c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.124196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef961a2-44cc-4a6e-a03f-2dc364fe919c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.125914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 132/270] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:04.132216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.132491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.132762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.159627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:04.160892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:04.174284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7ef06-228a-46c7-81e6-3f52e21a8a0d None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.174588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7ef06-228a-46c7-81e6-3f52e21a8a0d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.174840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7ef06-228a-46c7-81e6-3f52e21a8a0d None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.176378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 133/271] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:04.185120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.185413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.185665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.212434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:04.214889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:04.260334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 139/272] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:04.305385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 134/273] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:04.535347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.539156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.586947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.640460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d965d-e49b-4054-9fa3-a66387176adf None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.677239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.677923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.678210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.678483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.689974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:04.695348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:04.696219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:04.697242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 140/274] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:04.698049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e50278-aff4-4069-bda1-33877effc1f2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.704033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.719285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.743080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.743080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.743080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.743419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.744853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.746344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.748075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 135/275] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:04.753338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.798499 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:04.849240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1bd5c-00cf-43e6-94f9-3078ee974908 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.862831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad4ee4-ba51-4c3b-ab1a-1e20b2aab802 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:04.888218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.889183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.889662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.890198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.891070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:04.891569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.893146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.898660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a669cd-1842-48ec-a4db-bad802a85cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:04.899362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a669cd-1842-48ec-a4db-bad802a85cd9 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:04.899644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a669cd-1842-48ec-a4db-bad802a85cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:04.899913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a669cd-1842-48ec-a4db-bad802a85cd9 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:04.900873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a669cd-1842-48ec-a4db-bad802a85cd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:04.902153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a669cd-1842-48ec-a4db-bad802a85cd9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:04.909026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 141/276] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:04.910560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:04.969813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 136/277] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:04 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:05.006008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c4bc-7bb4-46f2-bca8-ba2f3d462133 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.006309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c4bc-7bb4-46f2-bca8-ba2f3d462133 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.006543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c4bc-7bb4-46f2-bca8-ba2f3d462133 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.008316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 137/278] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:05.014024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2946358-46a1-4579-82aa-5c8bd3c853ea None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.014304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2946358-46a1-4579-82aa-5c8bd3c853ea None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.014584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2946358-46a1-4579-82aa-5c8bd3c853ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.031286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3934c9-7027-4a83-a24b-ee4ca02894f4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.037156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b2946358-46a1-4579-82aa-5c8bd3c853ea None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:05.038627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b2946358-46a1-4579-82aa-5c8bd3c853ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:05.064066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.075825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.077344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.078133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.081731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] PATH_INFO: `/v3/users/19f6588bb3de4ca6b8fdc09c5f79876f` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.100882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.103796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] RBAC: Authorizing `identity:get_user(user_id=19f6588bb3de4ca6b8fdc09c5f79876f)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.106412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.109568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 142/279] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:04 2022] GET /identity/v3/users/19f6588bb3de4ca6b8fdc09c5f79876f => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:05.118908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.133799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 138/280] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:05.230101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5c0eb-71ef-48a4-be60-91e09b3d834a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.266616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.267156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.267434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.267709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.268438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, user.id=19f6588bb3de4ca6b8fdc09c5f79876f, scope.system=all) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:05.268748 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.270318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5138395e-d88a-4b96-beae-31115f9eb8ec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.275247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636495-d2dd-4474-a273-a3e1403a7cf5 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.275536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636495-d2dd-4474-a273-a3e1403a7cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.275807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c636495-d2dd-4474-a273-a3e1403a7cf5 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.276956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 143/281] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/role_assignments?user.id=19f6588bb3de4ca6b8fdc09c5f79876f&scope.system=all&role.id=9386846542804a8b96776ed9753a7628 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:05.278369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 139/282] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:05.284274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.284619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.284839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.307978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:05.309604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:05.359969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.387869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 144/283] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:05.420028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636495-d2dd-4474-a273-a3e1403a7cf5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.537151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c636495-d2dd-4474-a273-a3e1403a7cf5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.572736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.573432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.573714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.574018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.585708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:05.590944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:05.592258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:05.593079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 140/284] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:05.598198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.708417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.743842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03367a6f-8e99-49b5-8db6-9a2e7d9941be None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.784031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.784656 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.784938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:05.785212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:05.785921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:05.786791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:05.788536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:05.789952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.799735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 145/285] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:05.808221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:05.901698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:05.921565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0677a-5eab-43a7-b720-bee42f1bd892 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.964573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9c707-6934-441e-8920-308ec5590e47 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:05.998492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:05.999540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:05.999984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.000401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.009041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.009948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.010401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.010822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] PATH_INFO: `/v3/users/f4809d3119314abf8f7307412ce1614b` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.013270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] RBAC: Authorizing `identity:get_user(user_id=f4809d3119314abf8f7307412ce1614b)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.016360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.021939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 146/286] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/users/f4809d3119314abf8f7307412ce1614b => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:06.023122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:06.024700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:06.030423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:06.031538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:06.032507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:06.045606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 141/287] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:06.054259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.188120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.196345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009dc9a-e5cb-4f19-a2ba-f4c58740c1f6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.247027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.247648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.247931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.248204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.248992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:06.249303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.250739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.261991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402d072-6f3c-47b0-aa74-709fe6200c35 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.273288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 142/288] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:06.278934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.283303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.334442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.335014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.335298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.335574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.338088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.339547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.341352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 147/289] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:06.347356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.483638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64ff9d-a151-4c90-8e38-b251022ead45 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.548602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.549253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.549533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.549827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] PATH_INFO: `/v3/users/93c360b9cc6e4f9a90ae98ef7af689bd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.551189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] RBAC: Authorizing `identity:get_user(user_id=93c360b9cc6e4f9a90ae98ef7af689bd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.552670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.554307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 143/290] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/users/93c360b9cc6e4f9a90ae98ef7af689bd => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:06.560298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:06.573565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7fb19-a964-495d-b3b1-7e49f2866f79 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.646345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.651874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.652552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.656431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.656431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411/users/f4809d3119314abf8f7307412ce1614b/roles/5ff6eee575f04296a49a035f4b43e2bc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.657000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8101feb5c7e451b867c922095e58411, user_id=f4809d3119314abf8f7307412ce1614b, role_id=5ff6eee575f04296a49a035f4b43e2bc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.661246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.710302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def6cf-727d-4d4e-a58d-9d9f9dd53a55 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:06.745073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:06.745738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:06.746049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:06.746430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:06.781390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 148/291] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:06 2022] PUT /identity/v3/projects/b8101feb5c7e451b867c922095e58411/users/f4809d3119314abf8f7307412ce1614b/roles/5ff6eee575f04296a49a035f4b43e2bc => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:06.827150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:06.828726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:06.855614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:06.965642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 144/292] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:06.971682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.017728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.090999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8c38-f680-4e26-a385-60e4d996e406 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.134313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34dc52-2011-4a0e-942b-46b2c380ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.135052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34dc52-2011-4a0e-942b-46b2c380ec31 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.135340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34dc52-2011-4a0e-942b-46b2c380ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.135615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34dc52-2011-4a0e-942b-46b2c380ec31 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.142530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34dc52-2011-4a0e-942b-46b2c380ec31 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.144012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34dc52-2011-4a0e-942b-46b2c380ec31 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.146625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 149/293] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:06 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.152365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:07.294631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e829d-5161-46a9-a553-00e3a22244cb None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:07.329739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:07.357086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:07.358154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.358657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.359141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.360491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=93c360b9cc6e4f9a90ae98ef7af689bd) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:07.361051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:07.363904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a75a42-452e-4c6d-bf33-3910f456ffee None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:07.375826 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 145/294] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/role_assignments?user.id=93c360b9cc6e4f9a90ae98ef7af689bd&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=9386846542804a8b96776ed9753a7628 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:07.427284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36dbb-8b46-4486-b82c-88634c7f56be None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.427957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36dbb-8b46-4486-b82c-88634c7f56be None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.428439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be36dbb-8b46-4486-b82c-88634c7f56be None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.430354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 150/295] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.437263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9655ea-73b1-4e09-9dcd-4735e038947e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.437800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9655ea-73b1-4e09-9dcd-4735e038947e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.438282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9655ea-73b1-4e09-9dcd-4735e038947e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.487674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2e9655ea-73b1-4e09-9dcd-4735e038947e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.490121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2e9655ea-73b1-4e09-9dcd-4735e038947e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.624469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 146/296] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.659399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf80e7-1118-4af1-a62a-8871920e3b50 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.660049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf80e7-1118-4af1-a62a-8871920e3b50 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.660546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf80e7-1118-4af1-a62a-8871920e3b50 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.662172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 151/297] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.668059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.668904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.669352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.701224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.702721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.817975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa3c5-5bc0-4127-809b-addbfb505859 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.818771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa3c5-5bc0-4127-809b-addbfb505859 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.818771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fa3c5-5bc0-4127-809b-addbfb505859 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.820243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 152/298] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:07.826325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:07.826752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:07.827131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:07.835706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 147/299] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.854334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:07.855775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:07.932158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 153/300] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:07.950827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.002265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.065521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff623a9-790c-41d7-b410-fed79e57ad69 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.101793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.102504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.102792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.103068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.114964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:08.119984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:08.120874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:08.121676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 148/301] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:08.127098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.160021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.164515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.241686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6694f022-6c40-4eab-9a70-8f98e1ba5136 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.291869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.293110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.293805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.294440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.295862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:08.296365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.298966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.313274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 154/302] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.313732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cb2ab-fda6-4157-9b56-545bc0fe9a15 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.315071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.327906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.358191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.358834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.359114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.359388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.378668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:08.384058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:08.385065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 149/303] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:08.390910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.440716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.447976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91367628-71cd-4a41-a9c0-835692ff84da None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.484567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.485204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.485480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.485834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.487333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.489734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.493870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 155/304] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.493870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.520087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cb002-4bf8-46c6-ac1b-d805b14f4b61 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.557143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.557813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.558100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.558376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] PATH_INFO: `/v3/users/19f6588bb3de4ca6b8fdc09c5f79876f` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.559534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] RBAC: Authorizing `identity:get_user(user_id=19f6588bb3de4ca6b8fdc09c5f79876f)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.560990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.562774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 150/305] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/users/19f6588bb3de4ca6b8fdc09c5f79876f => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.567697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.604416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e106c-7323-4e52-902f-3d37dfd33c9d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.617394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.642454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.643049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.643365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.644177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.644281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:08.644567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.646042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.655195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 156/306] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:08.656313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.690799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.699183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd351b-288c-4044-8b5b-9c8e857c28a2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.734590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.735228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.735509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.735784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] PATH_INFO: `/v3/groups` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.736417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.737894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.769976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bed9a-504a-482a-a486-cb48e361f611 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:08.804791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:08.805447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:08.805728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:08.806033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] PATH_INFO: `/v3/system/users/19f6588bb3de4ca6b8fdc09c5f79876f/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:08.807456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=19f6588bb3de4ca6b8fdc09c5f79876f, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:08.808826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:08.821451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 151/307] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 24 03:26:08 2022] POST /identity/v3/groups => generated 229 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:08.822325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:08.921460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 157/308] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 24 03:26:08 2022] PUT /identity/v3/system/users/19f6588bb3de4ca6b8fdc09c5f79876f/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:08.961616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:08.969801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8d246-3d68-437e-87af-183afa85101d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.016915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e81e32-bcbe-4c81-a125-b96b51cba09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.017592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e81e32-bcbe-4c81-a125-b96b51cba09d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.017922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e81e32-bcbe-4c81-a125-b96b51cba09d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.018214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e81e32-bcbe-4c81-a125-b96b51cba09d None admin] PATH_INFO: `/v3/users/2446f611d028484dbc276db07e46be0e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.036264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e81e32-bcbe-4c81-a125-b96b51cba09d None admin] RBAC: Authorizing `identity:get_user(user_id=2446f611d028484dbc276db07e46be0e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.038198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e81e32-bcbe-4c81-a125-b96b51cba09d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.040324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 152/309] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:08 2022] GET /identity/v3/users/2446f611d028484dbc276db07e46be0e => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.046804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.120560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04fc7-1d1f-41a8-9c3c-2f0778967155 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.121091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04fc7-1d1f-41a8-9c3c-2f0778967155 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.121370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b04fc7-1d1f-41a8-9c3c-2f0778967155 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.123132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 153/310] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:09.128856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.129153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.129411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.150181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:09.151491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:09.160511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.171176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96997b-01a7-4929-8865-ed03761f248e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.217286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.218308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.218737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.219091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.220132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] RBAC: Adding query filter params (role.id=5ff6eee575f04296a49a035f4b43e2bc, user.id=2446f611d028484dbc276db07e46be0e, scope.system=all) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.221597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.223813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.230325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 158/311] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/role_assignments?user.id=2446f611d028484dbc276db07e46be0e&scope.system=all&role.id=5ff6eee575f04296a49a035f4b43e2bc => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.265009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 154/312] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:09.542701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.656415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59fbf-ccfa-4ba0-ac93-b5cee745d585 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.693083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.693727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.694034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.694310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.705106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:09.710911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:09.712079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:09.712890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 159/313] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:09.719549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.808193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.825189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976fd433-3d51-4768-85e5-da3e95093464 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:09.861423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:09.862090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:09.862372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:09.862646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:09.863319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] RBAC: Adding query filter params (name=reader) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:09.863680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:09.865098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:09.874365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 155/314] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:09.882851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:09.901502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:09.992553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa3d04-680f-4248-a4ba-cdd934d4539f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.030951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.031617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.031901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.032177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] PATH_INFO: `/v3/users/f4809d3119314abf8f7307412ce1614b` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.033374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] RBAC: Authorizing `identity:get_user(user_id=f4809d3119314abf8f7307412ce1614b)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.034973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.042005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 160/315] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:09 2022] GET /identity/v3/users/f4809d3119314abf8f7307412ce1614b => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:10.042746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.153341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ef3b4-cf3a-464c-85d0-eb62c5beb8af None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.193884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.194497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.194778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.195052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.212444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.266617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.268091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.372657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 156/316] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:10.378429 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.470851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.490907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e03fd-b3ff-4bb6-bef8-a0c1c0e2f100 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.527230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65affe1f-8f9b-4384-9cdc-4e2809fc0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.527872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affe1f-8f9b-4384-9cdc-4e2809fc0074 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.528158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affe1f-8f9b-4384-9cdc-4e2809fc0074 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.528435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65affe1f-8f9b-4384-9cdc-4e2809fc0074 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.529581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affe1f-8f9b-4384-9cdc-4e2809fc0074 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.531064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65affe1f-8f9b-4384-9cdc-4e2809fc0074 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.532686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 161/317] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:10.539347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:10.588296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:10.642779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331d73b-34c3-479d-8635-8e41857c588d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:10.679382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:10.680000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.680279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.680552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.681284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] RBAC: Adding query filter params (role.id=5ff6eee575f04296a49a035f4b43e2bc, scope.project.id=b8101feb5c7e451b867c922095e58411, user.id=f4809d3119314abf8f7307412ce1614b) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:10.681589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:10.683061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa57ba-4e68-424b-8fc0-1bc0eea2d407 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:10.689595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 157/318] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:10 2022] GET /identity/v3/role_assignments?user.id=f4809d3119314abf8f7307412ce1614b&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=5ff6eee575f04296a49a035f4b43e2bc => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:10.909316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d84eb-b088-406d-99d3-311df8dfcf1c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.909715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d84eb-b088-406d-99d3-311df8dfcf1c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.909936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d84eb-b088-406d-99d3-311df8dfcf1c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.911557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 162/319] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:10.917107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d718-b365-4e20-87f5-b1b2f9a09b65 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:10.917592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d718-b365-4e20-87f5-b1b2f9a09b65 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:10.917668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d718-b365-4e20-87f5-b1b2f9a09b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:10.936792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f421d718-b365-4e20-87f5-b1b2f9a09b65 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:10.938269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f421d718-b365-4e20-87f5-b1b2f9a09b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:11.008930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 158/320] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:11.043422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9bb1b-20dd-4322-96a8-f59a6a2afd0c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.043924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9bb1b-20dd-4322-96a8-f59a6a2afd0c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.043997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9bb1b-20dd-4322-96a8-f59a6a2afd0c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.045479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 163/321] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:11.050938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f096b-9f01-405f-848b-623db2601cde None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.051255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f096b-9f01-405f-848b-623db2601cde None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.051531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f096b-9f01-405f-848b-623db2601cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.070397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-293f096b-9f01-405f-848b-623db2601cde None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:11.071607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-293f096b-9f01-405f-848b-623db2601cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:11.108179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.142144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 159/322] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:11.187691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a648-0a47-42fb-b1c2-19e2ca8a0f08 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.187964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a648-0a47-42fb-b1c2-19e2ca8a0f08 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.188164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a648-0a47-42fb-b1c2-19e2ca8a0f08 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.189635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 164/323] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:11.195235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.195532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.195807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.215042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:11.216243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:11.278299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a648-0a47-42fb-b1c2-19e2ca8a0f08 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.291023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 160/324] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:11.392236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a648-0a47-42fb-b1c2-19e2ca8a0f08 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.418009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.428658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.429294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.429626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.429947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.431100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.432558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.434529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 165/325] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:11.439532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.463311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.530736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.534183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e744a5-0bf1-46cb-aa7f-406fbd72621e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.552408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907a1c-3c0f-4084-ab66-2fe9451a6ad8 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.570694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.571605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.571889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.572161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.582437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:11.587117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.587731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.588008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:11.588159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:11.589151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:11.590011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:11.594614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] PATH_INFO: `/v3/groups` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.594614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.594773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 161/326] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:11.594855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.594933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.688950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2aea0-eb20-4b7e-af49-c62e30092f21 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.701094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 166/327] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Aug 24 03:26:11 2022] POST /identity/v3/groups => generated 226 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:11.702176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.733721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.734446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.734727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.735012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.747329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:11.752782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:11.753800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:11.755318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 162/328] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:11.760683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.784818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.806100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:11.831182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49baa87-5960-49a4-a3ab-04270b09c1ba None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.871610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.872230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.872510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.872784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.873461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:11.873820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.875179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.877145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646da486-9d8a-4a7f-b016-dc1a386778b8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:11.884418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 167/329] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.890156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:11.922400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:11.923016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:11.923882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:11.923882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:11.924206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:11.924506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:11.925907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:11.936954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 163/330] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:11.942353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:12.025875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a481b-6ba9-4395-bdc2-76433f724296 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.046738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:12.069044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126934c5-c42d-4814-b2eb-68007f78870a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.071136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.071785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.072067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.072338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] PATH_INFO: `/v3/users/19f6588bb3de4ca6b8fdc09c5f79876f` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.073505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] RBAC: Authorizing `identity:get_user(user_id=19f6588bb3de4ca6b8fdc09c5f79876f)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:12.074999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:12.076598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 168/331] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/users/19f6588bb3de4ca6b8fdc09c5f79876f => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:12.083813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:12.136336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:12.136480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.136480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.136480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.136480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] PATH_INFO: `/v3/users/2446f611d028484dbc276db07e46be0e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.136805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] RBAC: Authorizing `identity:get_user(user_id=2446f611d028484dbc276db07e46be0e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:12.136805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:12.136805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 164/332] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:11 2022] GET /identity/v3/users/2446f611d028484dbc276db07e46be0e => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:12.136805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:12.202685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618644b6-0c72-4b58-8e39-de9f06591167 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.249064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.249694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.250051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.250388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.251133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] RBAC: Adding query filter params (role.id=9386846542804a8b96776ed9753a7628, user.id=19f6588bb3de4ca6b8fdc09c5f79876f, scope.system=all) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:12.251494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:12.251593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a16713-d237-4164-a8fa-67c69aeb684e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:12.252979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69d52d-4300-4b79-9bc9-5174b9ff7e37 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:12.268465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 169/333] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:12 2022] GET /identity/v3/role_assignments?user.id=19f6588bb3de4ca6b8fdc09c5f79876f&scope.system=all&role.id=9386846542804a8b96776ed9753a7628 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:12.300798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4316425-be5b-473d-ac08-7dd2102f126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:12.301535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4316425-be5b-473d-ac08-7dd2102f126c None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:12.301915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4316425-be5b-473d-ac08-7dd2102f126c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:12.302199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4316425-be5b-473d-ac08-7dd2102f126c None admin] PATH_INFO: `/v3/system/users/2446f611d028484dbc276db07e46be0e/roles/5ff6eee575f04296a49a035f4b43e2bc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:12.304090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4316425-be5b-473d-ac08-7dd2102f126c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2446f611d028484dbc276db07e46be0e, role_id=5ff6eee575f04296a49a035f4b43e2bc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:12.318988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4316425-be5b-473d-ac08-7dd2102f126c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:12.464525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 165/334] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Aug 24 03:26:12 2022] PUT /identity/v3/system/users/2446f611d028484dbc276db07e46be0e/roles/5ff6eee575f04296a49a035f4b43e2bc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:13.929865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575dc88-12cf-4650-a1bd-11635962a943 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.930408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575dc88-12cf-4650-a1bd-11635962a943 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.930408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575dc88-12cf-4650-a1bd-11635962a943 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.932024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 170/335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:13.937236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d96c4-6017-41ea-b765-98058e33a2af None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:13.937674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d96c4-6017-41ea-b765-98058e33a2af None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:13.937911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d96c4-6017-41ea-b765-98058e33a2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:13.966834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-348d96c4-6017-41ea-b765-98058e33a2af None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:13.968050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-348d96c4-6017-41ea-b765-98058e33a2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:13.979539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.042107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 166/336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:14.423675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575dc88-12cf-4650-a1bd-11635962a943 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.518174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.561308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e0ce-9336-4cae-b10d-e548e7fa3dfd None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.561979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e0ce-9336-4cae-b10d-e548e7fa3dfd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.562452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e0ce-9336-4cae-b10d-e548e7fa3dfd None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.564250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 167/337] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:14.565870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575dc88-12cf-4650-a1bd-11635962a943 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.572576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc000-dffc-4d52-8f9c-985543fa1fd6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.573156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc000-dffc-4d52-8f9c-985543fa1fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.573639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc000-dffc-4d52-8f9c-985543fa1fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.608963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.609793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.610094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.610372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.614895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3a3bc000-dffc-4d52-8f9c-985543fa1fd6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:14.616587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3a3bc000-dffc-4d52-8f9c-985543fa1fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:14.633375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:14.639929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:14.640881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:14.641671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 171/338] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:14.647644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.741857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 168/339] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:14.743435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229689d-17d0-4eb9-9005-c5b47d17ff97 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.743866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229689d-17d0-4eb9-9005-c5b47d17ff97 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.744286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229689d-17d0-4eb9-9005-c5b47d17ff97 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.745691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 169/340] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:14.751264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.751726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.752137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.790295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:14.791741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:14.838614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afac61-0d7a-40fb-86cc-16007ecf8a08 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:14.885323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:14.900060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:14.900977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:14.901421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:14.902068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:14.902968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:14.903485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:14.905129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828c30c-c04a-4a79-b741-1d7e85e9cb8d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:14.909317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 170/341] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:14.917155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 172/342] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:14.923247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:14.928625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.057472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac222a-ec48-434d-8a9c-3b7b5e325705 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.101649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.102342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.102626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.102901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.185675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.187171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.189983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.199956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0fd2-45fd-4f37-a610-554fa401ce63 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.200868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0fd2-45fd-4f37-a610-554fa401ce63 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.201357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def0fd2-45fd-4f37-a610-554fa401ce63 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.205824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 173/343] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:15.214309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b048-667a-4f86-9a61-571df4822594 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.214865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b048-667a-4f86-9a61-571df4822594 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.215374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b048-667a-4f86-9a61-571df4822594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.248466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4454b048-667a-4f86-9a61-571df4822594 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:15.250297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4454b048-667a-4f86-9a61-571df4822594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:15.315591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 171/344] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:15.316714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.345622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 174/345] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:15.346850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b048-667a-4f86-9a61-571df4822594 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.438458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2f04b-6ee3-4d0d-aa94-76ac95e581cf None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.440989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.481803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.481803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.481803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.481803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.490253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:15.495033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:15.495942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 172/346] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:15.497197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.518150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b048-667a-4f86-9a61-571df4822594 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.551126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.581291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.581291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.581291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.581291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.592378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:15.597679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:15.599981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 175/347] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:15.602073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.609789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af94b7-284d-47cd-af5e-8884e85d4ba5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.644204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.645444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.645720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.646011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.647404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.649035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.651338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 173/348] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.652345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.686614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.775310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a0ae0-edd0-4dab-b499-622727515048 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.813568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.814489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.815304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.815891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.817396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:15.817902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.819444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.828765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 174/349] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.829892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:15.893428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a949a-d1c2-48af-aec9-9df12b60e915 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.942578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:15.953078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d95d-d8a2-4aea-8c40-54d191479d40 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:15.959655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:15.960285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:15.960571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:15.960845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:15.961791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:15.962119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:15.963512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:15.973011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 176/350] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:15.973903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.002676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.003969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.004965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.005446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.015879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.018459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.020375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 175/351] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.025369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.029616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.109107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d7786-5253-40ba-aec4-6a9a78601e99 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.159284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.159471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.159728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.160001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.169784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77f3ee-b93b-4cce-a3b1-f2bbfa9261bd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.216612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.216968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.217233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.217512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.233014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:16.241690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:16.242699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:16.243521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 176/352] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:16.244203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.258798 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.261629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.271273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.313092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.382740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57875f5a-7295-4f6a-b4ba-99c213851597 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.385456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 177/353] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:16.388848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.432277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.432874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.434066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.434366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.524584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3035ef64-bf01-4337-a4a7-825408dc357d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.526051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.527755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.552096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.569118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.570009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.570438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.570899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.571659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=9386846542804a8b96776ed9753a7628, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:16.571970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.573449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96171540-9385-4dcf-bd66-b0b059a537e6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.579438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 178/354] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=9386846542804a8b96776ed9753a7628 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.581902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196668a9-e4f4-45fc-921c-c4c2085c5535 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.582235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196668a9-e4f4-45fc-921c-c4c2085c5535 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.582511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196668a9-e4f4-45fc-921c-c4c2085c5535 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.583838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 179/355] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:16.584617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196668a9-e4f4-45fc-921c-c4c2085c5535 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.591358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.663361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 177/356] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:16.664482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.742321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196668a9-e4f4-45fc-921c-c4c2085c5535 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.780172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.780799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.781267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.781689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.782539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:16.782995 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.784536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2a408-591d-4249-980b-56c41689e4d2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.791434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f019a7-8f8a-45c4-a62b-69d44db9ae38 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:16.794485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 180/357] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.795790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ef35-0363-4243-a2d9-b5aa98f51057 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.796086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ef35-0363-4243-a2d9-b5aa98f51057 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.796364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ef35-0363-4243-a2d9-b5aa98f51057 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.797696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 181/358] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:16.798626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.799150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.799441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.819907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.824175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:16.825407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:16.839372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:16.840081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:16.840364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:16.840639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:16.843751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:16.843751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:16.845257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 178/359] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:16.845995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.903563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:16.912763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 182/360] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:16.913505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:16.963156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f7bdf-cf0c-4d56-81fb-e8c961521fc2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.013085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b288c-cbc3-487a-85dd-65bd9bf8a7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.013654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b288c-cbc3-487a-85dd-65bd9bf8a7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.013966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b288c-cbc3-487a-85dd-65bd9bf8a7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.014242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b288c-cbc3-487a-85dd-65bd9bf8a7d1 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.015760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b288c-cbc3-487a-85dd-65bd9bf8a7d1 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.017546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b288c-cbc3-487a-85dd-65bd9bf8a7d1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.023992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 179/361] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.025389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.025634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.025980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.044244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcce21-8f16-4926-b3e2-06b7b4f7b5d4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.053799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:17.055293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:17.086953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.087626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.088187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.088467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] PATH_INFO: `/v3/users/2446f611d028484dbc276db07e46be0e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.090532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] RBAC: Authorizing `identity:get_user(user_id=2446f611d028484dbc276db07e46be0e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.092682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.095680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 183/362] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:26:16 2022] GET /identity/v3/users/2446f611d028484dbc276db07e46be0e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.097482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.127555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.149284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 180/363] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:17.151203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.179994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.221671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b746b89-7ddb-416a-b7de-4d3bb6fb3fec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.264434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784874a2-39dd-4b43-a71e-4706f1f6d14a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.270104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.271007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.271292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.271563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.272702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.274731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.276957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 184/364] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.278077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.314436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.315084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.315365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.315645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.318787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.320243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.327059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 181/365] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.327969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.401754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.418636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974e22f-58e8-4919-835c-44e7a559b9ab None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.465863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.478771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.479402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.479936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.481917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.482991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] RBAC: Adding query filter params (role.id=5ff6eee575f04296a49a035f4b43e2bc, user.id=2446f611d028484dbc276db07e46be0e, scope.system=all) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.483308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.484885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e6e3-63a6-43fe-9c7a-9ac7f115dccd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.486769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.502368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 185/366] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/role_assignments?user.id=2446f611d028484dbc276db07e46be0e&scope.system=all&role.id=5ff6eee575f04296a49a035f4b43e2bc => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.503509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.544777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.545500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.546122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.546602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.563928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:17.571335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:17.572552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:17.573607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:17.578208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 182/367] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:17.578208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.647316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109fa54-c8d8-4abd-a478-f69c81de2738 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.688250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.689630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.690169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.690645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.691627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.692162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.693859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.697606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1251cf-0033-42ac-9de6-994c65278cd2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.700848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 186/368] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.702125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.716150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.742787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.743415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.743698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.743976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.744734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=9386846542804a8b96776ed9753a7628, scope.project.id=b8101feb5c7e451b867c922095e58411) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.745046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.746802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.753584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 183/369] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=9386846542804a8b96776ed9753a7628 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.754528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.773524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:17.832979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd862f-7a2f-4b9b-ad4b-74dfd30ac002 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.882499 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.883437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.883721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.883989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.889108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cc4f5-b498-4fc5-869b-b6d0a4313dfc None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:17.899361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:17.906460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:17.907439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:17.909411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 187/370] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:17.914207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:17.938576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:17.939630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:17.940092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:17.940701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:17.942174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:17.942697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:17.944326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:17.955149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 184/371] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:17.962197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.017865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.048665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e7aef-b7ee-4d70-a216-b3c9c7a7cdb3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.066092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.091526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.092147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.092810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.093085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.093752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:18.094159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.095819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.106723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 188/372] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.115862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.136279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a9fa-5a5a-438e-a6a0-280d2ee41222 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.205246 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.206269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.206774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.207279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.309396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec362-5613-478a-b89c-fb2172af88dd None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.333291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.334853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.356315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.358446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.359169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.359867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.407801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.451891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.506784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.507512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.525932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 185/373] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:18.541017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.632102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 189/374] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:18.638560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.754926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.770647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb395-0fd5-4747-a198-5bb20b848187 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.783495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c796f1e-d8fe-410c-a5af-464d11549a62 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.822878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.823531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.823814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.824102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] PATH_INFO: `/v3/projects/9a304260abbd4fa38198d15914f9035c` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.826372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=9a304260abbd4fa38198d15914f9035c)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.827836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.829920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 190/375] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/projects/9a304260abbd4fa38198d15914f9035c => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:18.830376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.831024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.831306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.831580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:18.837019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:18.838494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:18.840425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 186/376] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:18.842009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.875379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:18.898222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:18.955580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6aa57-f1ed-4f08-b799-1168adce0fb0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:18.993522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aba29e-c2f7-4e52-b7e4-aa467d20279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:18.994586 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aba29e-c2f7-4e52-b7e4-aa467d20279d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:18.995092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aba29e-c2f7-4e52-b7e4-aa467d20279d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:18.995599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aba29e-c2f7-4e52-b7e4-aa467d20279d None admin] PATH_INFO: `/v3/groups/63a389c09bb94d83ad7ed710d5e2c890` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.002339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aba29e-c2f7-4e52-b7e4-aa467d20279d None admin] RBAC: Authorizing `identity:get_group(group_id=63a389c09bb94d83ad7ed710d5e2c890)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.004166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aba29e-c2f7-4e52-b7e4-aa467d20279d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.006414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 191/377] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/groups/63a389c09bb94d83ad7ed710d5e2c890 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.007916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85c08-42ac-4c5b-a448-4491603574e6 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.008422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85c08-42ac-4c5b-a448-4491603574e6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.008896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d85c08-42ac-4c5b-a448-4491603574e6 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.010429 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 192/378] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:19.013078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85c08-42ac-4c5b-a448-4491603574e6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.027411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.043241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e083c-79bf-4bb3-8b4a-937257ed3cae None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.090604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba42528-554c-4b2b-a44f-93758d1279f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.091885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba42528-554c-4b2b-a44f-93758d1279f0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.092373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba42528-554c-4b2b-a44f-93758d1279f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.092957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba42528-554c-4b2b-a44f-93758d1279f0 None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.094901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba42528-554c-4b2b-a44f-93758d1279f0 None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.096592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba42528-554c-4b2b-a44f-93758d1279f0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.102009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 187/379] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:18 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:19.103576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.104191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.104616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.133337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:19.134900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:19.146335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d85c08-42ac-4c5b-a448-4491603574e6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.185296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.186156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.186592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.186965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.187841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] RBAC: Adding query filter params (group.id=63a389c09bb94d83ad7ed710d5e2c890, role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=9a304260abbd4fa38198d15914f9035c) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:19.188255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.191153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.197297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 193/380] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/role_assignments?group.id=63a389c09bb94d83ad7ed710d5e2c890&scope.project.id=9a304260abbd4fa38198d15914f9035c&role.id=bde35209edd64a3187d196af53f70e5d => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.198522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.218255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 188/381] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:19.317796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.342877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337fccd-4bf5-4bae-b39c-6a38859655fb None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.389389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.390049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.390394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.390681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.391425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=b8101feb5c7e451b867c922095e58411) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:19.391735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.393195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.400164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 194/382] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.535481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.539515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.672574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477122f-198f-4ff5-9e21-47509f4aaaee None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.718558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.719221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.719503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.719778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.731256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:19.735947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:19.736896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:19.738936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 189/383] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:19.743367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:19.880927 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30d0e-97e3-403e-8c27-8582f53de40d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:19.928434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:19.929064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:19.929348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:19.929626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:19.930334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:19.930640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:19.932011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:19.934819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:19.943743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 195/384] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:19.949224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.018486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.060223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14c4e-2c8f-4dc8-8ba2-ed4ae73efa77 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.101329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a83d09-e098-46e3-9eac-e834b4d2d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.102263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83d09-e098-46e3-9eac-e834b4d2d423 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.102704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83d09-e098-46e3-9eac-e834b4d2d423 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.103124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a83d09-e098-46e3-9eac-e834b4d2d423 None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.104400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a83d09-e098-46e3-9eac-e834b4d2d423 None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.106025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a83d09-e098-46e3-9eac-e834b4d2d423 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.108048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 190/385] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:19 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.113809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.153742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8461e-ba5e-4ded-aa53-908b1689f916 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.154062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8461e-ba5e-4ded-aa53-908b1689f916 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.154393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8461e-ba5e-4ded-aa53-908b1689f916 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.156087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 191/386] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:20.161467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.161745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.162066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.182727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:20.183942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:20.297396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 192/387] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:20.322826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800f1d7-ed19-433f-a14f-3abf500e7577 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.366603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00877a4-0f68-49a0-ac4b-3bd97939a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.367262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00877a4-0f68-49a0-ac4b-3bd97939a036 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.367548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00877a4-0f68-49a0-ac4b-3bd97939a036 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.367825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00877a4-0f68-49a0-ac4b-3bd97939a036 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.369013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00877a4-0f68-49a0-ac4b-3bd97939a036 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.370512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00877a4-0f68-49a0-ac4b-3bd97939a036 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.372321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 196/388] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:20.378218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.477888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.532093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483dd6b-5a17-4153-9329-66dafcd7e659 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.570058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.570672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.570916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.571309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/groups/f03eeb17f2f1467083bba431409fe7f3/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.573334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] RBAC: Authorizing `identity:create_grant(project_id=8de9ed4401434e04a0f40cda66af4ddc, group_id=f03eeb17f2f1467083bba431409fe7f3, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:20.574805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:20.651057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 193/389] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:20 2022] PUT /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/groups/f03eeb17f2f1467083bba431409fe7f3/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:20.681046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff434ee-6ca3-4e61-9bfb-0eeeafe8d7fa None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.681262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:20.681362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff434ee-6ca3-4e61-9bfb-0eeeafe8d7fa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.681591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff434ee-6ca3-4e61-9bfb-0eeeafe8d7fa None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.683633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 197/390] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:20.689881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.690452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.690929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.721865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:20.723948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:20.812160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c71803-9693-45b5-ba4c-131fe247ae8b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:20.840932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.854799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:20.856030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:20.856691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:20.857228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:20.857703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:20.870326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:20.872588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 198/391] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:20.878050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:20.884144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:20.884967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 194/392] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:20.887470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.009401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bce95-873b-4f0a-bd09-5693212155a8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.052094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.052725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.053010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.053282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.054012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:21.054292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.055688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.064872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 199/393] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.072785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.198887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346048-7638-46c5-91f1-d953d3dacda2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.242501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.243176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.243506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.243796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.244959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.246461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.248384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 195/394] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.253631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.317950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.326980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.394784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29ee73-1f90-4b06-b6e0-da83965d2be7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.395723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.454769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d680b73-6806-49b4-a2b2-f22e387c4cce None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.497967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.498631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.498917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.499194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.512413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:21.517678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:21.518695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:21.520059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:21.520682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.520682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.520837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 196/395] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:21.520903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.520903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.521636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.527328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.527596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.529442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 200/396] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:21.536370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.649496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989d48-af5e-4441-99fd-b8c904388268 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.661592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.692089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.692708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.692982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.693255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.693953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:21.694254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.695640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.715064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 197/397] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:21.720549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.752645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d49710-45fa-4a53-9d74-09cb5774cc34 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.785258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:21.806292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.806292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.806881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.806881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/groups/f03eeb17f2f1467083bba431409fe7f3/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.812444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8de9ed4401434e04a0f40cda66af4ddc, group_id=f03eeb17f2f1467083bba431409fe7f3, role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.814899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.891130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf1049-9600-454f-8e61-a7f510da5ef0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:21.929241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 201/398] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:21 2022] PUT /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc/groups/f03eeb17f2f1467083bba431409fe7f3/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:21.941224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7379df30-bf18-49cc-8ce1-e8afff747b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:21.941997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379df30-bf18-49cc-8ce1-e8afff747b0d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.942389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379df30-bf18-49cc-8ce1-e8afff747b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.942717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379df30-bf18-49cc-8ce1-e8afff747b0d None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.944061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379df30-bf18-49cc-8ce1-e8afff747b0d None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:21.945842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7379df30-bf18-49cc-8ce1-e8afff747b0d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:21.948224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 198/399] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:21.954123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:21.977363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f0ed-7fff-4cab-b020-2911745915e6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.977651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f0ed-7fff-4cab-b020-2911745915e6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.977929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f0ed-7fff-4cab-b020-2911745915e6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:21.979737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 199/400] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:21.985506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5acd6-abaf-4ea1-bc49-afdd4aa0503d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:21.985844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5acd6-abaf-4ea1-bc49-afdd4aa0503d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:21.986180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5acd6-abaf-4ea1-bc49-afdd4aa0503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.016488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-49c5acd6-abaf-4ea1-bc49-afdd4aa0503d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:22.017713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-49c5acd6-abaf-4ea1-bc49-afdd4aa0503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:22.076980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.123178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5bcee0-7e4d-4136-933c-3388d9dafdd5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.123783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 200/401] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:22.125306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2acf-f9e2-43d9-82c0-b083991a3664 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.125845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2acf-f9e2-43d9-82c0-b083991a3664 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.127088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd2acf-f9e2-43d9-82c0-b083991a3664 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.127752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 201/402] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:22.132971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.133251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.133526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.159200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:22.161385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:22.169344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.170507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.171012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.171501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.173017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.174862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.177290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 202/403] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:21 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.183096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.256517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 202/404] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:22.259849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.306518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e87c6-c982-4656-9302-1cf56b9ab914 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.357405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.358208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.358481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.358755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411/groups/f03eeb17f2f1467083bba431409fe7f3/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.360692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] RBAC: Authorizing `identity:create_grant(project_id=b8101feb5c7e451b867c922095e58411, group_id=f03eeb17f2f1467083bba431409fe7f3, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.362262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.438267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 203/405] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:22 2022] PUT /identity/v3/projects/b8101feb5c7e451b867c922095e58411/groups/f03eeb17f2f1467083bba431409fe7f3/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:26:22.482226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.606160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.611206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e2fa1-2573-4131-908a-27f47bae568a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.616046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.662488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.663142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.663486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.663766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.678673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:22.684820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:22.685787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:22.686637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:22.687271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 203/406] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:22.693378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.750087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a75f2c4-0b7f-47c1-9e1b-79f05f1753af None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.769058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:22.809981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.811042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.811537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.812000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.832441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:22.839228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:22.840143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:22.841000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:22.848631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 204/407] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:22.855552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.872186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4cbd2-6699-49b7-85a3-f9f0e334fb48 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:22.927893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:22.928533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:22.928817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:22.929093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:22.929905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:22.930216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:22.933816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:22.945752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 204/408] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:22.950573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:22.998148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.048507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15979147-0b66-4b7a-aa89-a68323b42fa9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.123247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.124115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.124590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.125022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.125881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:23.127686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.129340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.146155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd26ee-b82d-4a6d-9daa-232de7047d4d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.148318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 205/409] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:23.154190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.188149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.189741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.190221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.190641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] PATH_INFO: `/v3/groups/63a389c09bb94d83ad7ed710d5e2c890` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.192504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] RBAC: Authorizing `identity:get_group(group_id=63a389c09bb94d83ad7ed710d5e2c890)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.194508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.196880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 205/410] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:22 2022] GET /identity/v3/groups/63a389c09bb94d83ad7ed710d5e2c890 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.204745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.235115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.307039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14758a92-c9ef-4d3f-a9b3-49b7d18904a4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.327815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.341632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d8612-e444-49c8-b629-1b37bfd7a2a4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.348189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad1afb-6e5d-4353-8962-3275c86b55d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.348956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1afb-6e5d-4353-8962-3275c86b55d6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.349341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1afb-6e5d-4353-8962-3275c86b55d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.349717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad1afb-6e5d-4353-8962-3275c86b55d6 None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.350968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1afb-6e5d-4353-8962-3275c86b55d6 None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.352595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad1afb-6e5d-4353-8962-3275c86b55d6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.354637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 206/411] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:23.356067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620401e6-b71d-49f6-9188-15ff9749fe0f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.356471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620401e6-b71d-49f6-9188-15ff9749fe0f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.356854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620401e6-b71d-49f6-9188-15ff9749fe0f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.362618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 207/412] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:23.363593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620401e6-b71d-49f6-9188-15ff9749fe0f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.384554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37ef37-3001-4933-848b-3000193df89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.385426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ef37-3001-4933-848b-3000193df89f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.386018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ef37-3001-4933-848b-3000193df89f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.386463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37ef37-3001-4933-848b-3000193df89f None admin] PATH_INFO: `/v3/projects/9a304260abbd4fa38198d15914f9035c` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.388142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ef37-3001-4933-848b-3000193df89f None admin] RBAC: Authorizing `identity:get_project(project_id=9a304260abbd4fa38198d15914f9035c)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.389782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37ef37-3001-4933-848b-3000193df89f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.392549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 206/413] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/projects/9a304260abbd4fa38198d15914f9035c => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.393933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.394897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.395290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.416954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:23.418840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:23.493666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620401e6-b71d-49f6-9188-15ff9749fe0f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.496962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.521281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 207/414] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:23.522460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.573382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.579359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.579754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.580139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.581528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.583500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.585220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 208/415] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:23.591127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:23.643150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:23.671076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b9133-75bf-441c-859e-9f047d6ca4e8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.719786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1b0f-094c-47a7-a06c-0ff1c3c250b0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:23.757699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.758406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.758690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.758969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] PATH_INFO: `/v3/projects/9a304260abbd4fa38198d15914f9035c/groups/63a389c09bb94d83ad7ed710d5e2c890/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.765289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a304260abbd4fa38198d15914f9035c, group_id=63a389c09bb94d83ad7ed710d5e2c890, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.766783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.775502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:23.776056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:23.776342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:23.776624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411/groups/f03eeb17f2f1467083bba431409fe7f3/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:23.778938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=b8101feb5c7e451b867c922095e58411, group_id=f03eeb17f2f1467083bba431409fe7f3, role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:23.780372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:23.871763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 208/416] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:23 2022] PUT /identity/v3/projects/9a304260abbd4fa38198d15914f9035c/groups/63a389c09bb94d83ad7ed710d5e2c890/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:23.896503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 209/417] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Aug 24 03:26:23 2022] PUT /identity/v3/projects/b8101feb5c7e451b867c922095e58411/groups/f03eeb17f2f1467083bba431409fe7f3/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:23.911743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.040096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de0a8b-063c-4b7e-9b99-bb057fc31ab3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.088518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721948c8-b965-4495-a3a2-7a889a830540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.089172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721948c8-b965-4495-a3a2-7a889a830540 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.089547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721948c8-b965-4495-a3a2-7a889a830540 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.089854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721948c8-b965-4495-a3a2-7a889a830540 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.109299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721948c8-b965-4495-a3a2-7a889a830540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-721948c8-b965-4495-a3a2-7a889a830540 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:24.114355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:24.117606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:24.118524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 209/418] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:24.124947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.176326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.253582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaafe38-382c-4a31-bfc0-c493a00e5c12 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.282146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e842632-d6ea-4422-bc4d-4c62fc091960 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.282472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e842632-d6ea-4422-bc4d-4c62fc091960 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.282696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e842632-d6ea-4422-bc4d-4c62fc091960 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.284202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 210/419] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:24.299435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18ca6e-c697-4b67-b4dc-7630f3986445 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.299750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18ca6e-c697-4b67-b4dc-7630f3986445 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.299993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18ca6e-c697-4b67-b4dc-7630f3986445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.300490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.301322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.301820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.302305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.303186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] RBAC: Adding query filter params (name=member) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:24.303685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.305288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.314999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 210/420] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:24.320837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.351858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2b18ca6e-c697-4b67-b4dc-7630f3986445 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:24.353056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2b18ca6e-c697-4b67-b4dc-7630f3986445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:24.355282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.426896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.442127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23160d1-edda-49d2-8f47-25b52b735bec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.465857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 211/421] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:24.505302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:24.505981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.506264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.506537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.588738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b9614-9da7-4225-bea5-0d88975cbd56 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.590068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b9614-9da7-4225-bea5-0d88975cbd56 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.590567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b9614-9da7-4225-bea5-0d88975cbd56 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.593044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 212/422] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:24.599346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:24.599617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:24.599895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:24.623955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:24.625446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:24.637653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:24.638868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:24.774018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 213/423] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:24.791363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.798106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.803997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 211/424] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:24.814910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:24.907458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:24.936737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c2d10-a4be-40bb-af3f-12076e2830bf None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:24.970284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd3c0a-dfae-4bd9-8b58-e80db501ad13 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.013039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.013670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.013972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.014242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.021432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.022088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.022365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.022635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.027116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.028488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.030114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 212/425] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.035827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.036664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:25.041367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:25.046434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:25.047262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 214/426] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:25.052232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.160982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.178490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc216c5-1319-4583-b7b6-65196fc3598c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.202624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d658-e6b3-4ba3-af8a-b52d3dc68aed None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.207658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.217380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.218108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.218388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.218658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.219337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.219639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.221412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.234811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 215/427] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.234811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.249122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47690221-db12-467b-86e1-cec252e671db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.250453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690221-db12-467b-86e1-cec252e671db None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.251205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690221-db12-467b-86e1-cec252e671db None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.251657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47690221-db12-467b-86e1-cec252e671db None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.253478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47690221-db12-467b-86e1-cec252e671db None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.255161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47690221-db12-467b-86e1-cec252e671db None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.257886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 213/428] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.258983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47690221-db12-467b-86e1-cec252e671db None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.349812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5118eaa1-c6bb-48a8-b1f6-e2bb80392952 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.379964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47690221-db12-467b-86e1-cec252e671db None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.386799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.387433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.387708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.388034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.399993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:25.405372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:25.406323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 216/429] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:25.411824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.422731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.428701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.429940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.430364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.430843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.463733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.503593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.505131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.525156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb1338-2dd6-41b6-b82b-5bd43e224f3d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.567033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.568007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.568491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.569056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.570155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=9386846542804a8b96776ed9753a7628, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.570694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.572698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.579738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 217/430] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=9386846542804a8b96776ed9753a7628 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.580911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.656466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 214/431] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:25.662159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.699927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b7855-43ab-46ea-9d9f-8c49656715f6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.718197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.741382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.743572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.743572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.743572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.744312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:25.744825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.746533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.751770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:25.758777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 218/432] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:25.768769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.859979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb93908-72cc-4cb9-9ffd-e2be07410519 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.899046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d42c2e-23e0-4735-873a-4888738f75d1 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:25.902391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.903115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.903465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.903812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] PATH_INFO: `/v3/projects/8de9ed4401434e04a0f40cda66af4ddc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.905044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] RBAC: Authorizing `identity:get_project(project_id=8de9ed4401434e04a0f40cda66af4ddc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:25.906677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:25.913081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 215/433] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/projects/8de9ed4401434e04a0f40cda66af4ddc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:25.914557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:25.936804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:25.937470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:25.937757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:25.938066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:25.988401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.014086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.015828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.024956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.029832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b1179-7a90-4474-8452-a5ef8300ebdc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.068426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.069568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.070069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.070552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.071892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.073621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.080491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 216/434] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.082115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.129795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 219/435] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:26.133242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.204373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fe10b-e989-40ff-bfde-00ea913f3db7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.228203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.248062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.248679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.248956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.249223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.250848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=8de9ed4401434e04a0f40cda66af4ddc) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:26.250848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.251700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3d4f6-1faf-4447-bf80-481bd36cc0ba None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.259594 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 217/436] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=8de9ed4401434e04a0f40cda66af4ddc&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:26.266599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f1e5f-7912-4b08-ab4c-104f481d2deb None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.266599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f1e5f-7912-4b08-ab4c-104f481d2deb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.266599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f1e5f-7912-4b08-ab4c-104f481d2deb None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.266599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 218/437] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:26.268498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f611b-a56e-4d38-8962-d96e0595177b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.269713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f611b-a56e-4d38-8962-d96e0595177b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.270173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f611b-a56e-4d38-8962-d96e0595177b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.275093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1febb-74ee-4195-9774-043a85ef79a4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.290828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a61f611b-a56e-4d38-8962-d96e0595177b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:26.292096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a61f611b-a56e-4d38-8962-d96e0595177b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:26.320204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68573a32-c889-4c7f-bac0-a6eec180fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.320859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68573a32-c889-4c7f-bac0-a6eec180fe9f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.321142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68573a32-c889-4c7f-bac0-a6eec180fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.321420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68573a32-c889-4c7f-bac0-a6eec180fe9f None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.323802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.325283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68573a32-c889-4c7f-bac0-a6eec180fe9f None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.326856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68573a32-c889-4c7f-bac0-a6eec180fe9f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.328735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 220/438] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.329991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be954d3-4f3a-4c79-910a-83907b2f1806 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.330272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be954d3-4f3a-4c79-910a-83907b2f1806 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.330543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be954d3-4f3a-4c79-910a-83907b2f1806 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.332315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 221/439] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:26.341792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be954d3-4f3a-4c79-910a-83907b2f1806 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.395247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 219/440] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:26.396728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.397018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.397290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.416122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:26.417441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:26.480945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be954d3-4f3a-4c79-910a-83907b2f1806 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.509825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 220/441] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:26.535772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.536418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.536698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.537024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.538264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.539711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.541448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 222/442] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.547212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.650148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.659819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23572992-2824-4f76-bb14-0ffdfc3edecb None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.666381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.686471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.706402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.707020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.707300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.707569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.708302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=9386846542804a8b96776ed9753a7628, scope.project.id=b8101feb5c7e451b867c922095e58411) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:26.708609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:26.710136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:26.716850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 221/443] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=9386846542804a8b96776ed9753a7628 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:26.788266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.806380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5005d-46a2-4a73-9794-92416ca95a31 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.851477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.852128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.852410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.852686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.864734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:26.869527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:26.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:26.871321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:26.876276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 223/444] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:26.876494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:26.923127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492e908-8bf9-432d-8f7a-95a9e6c743d9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:26.965404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:26.970567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:26.971215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:26.971489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:26.972295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:26.985690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:26.990886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:26.991828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:26.992676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 222/445] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:26.998123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.001860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb6384-a01b-48a3-82c0-57991bc42e13 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.016466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.051563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.052104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.052636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.052636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.053355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.053665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.055107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.065243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 224/446] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:27.071676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.122668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ea71-2fdf-4792-a41f-5dbaee18bbff None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.157801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.158404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.158688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.158954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.160210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.160509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.161895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.170135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 223/447] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.176024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.180148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f624ba3-4f46-4113-b364-a01e5edc50fd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.214366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.214971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.215250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.215522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.218622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.256200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.279549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe9696-115d-4cd2-907f-46fbce2704f3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.283386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.285447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.314446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.314985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.315268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.315547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.383639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.384209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 225/448] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 03:26:27.385118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.390218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.423539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.461858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.485534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 224/449] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:27.491240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480407e-c85b-4a0c-82d8-dc30a4aac540 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.492646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.527242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.527868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.528150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.528424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] PATH_INFO: `/v3/projects/9a304260abbd4fa38198d15914f9035c` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.529547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] RBAC: Authorizing `identity:get_project(project_id=9a304260abbd4fa38198d15914f9035c)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.531039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.532656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 226/450] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/projects/9a304260abbd4fa38198d15914f9035c => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.538921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.600695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bddd31-ce01-4e57-aeee-a7690f7408e9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.635485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.636113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.636394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.636666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] PATH_INFO: `/v3/projects/b8101feb5c7e451b867c922095e58411` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.637789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8101feb5c7e451b867c922095e58411)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.639261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.640885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 225/451] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/projects/b8101feb5c7e451b867c922095e58411 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.647152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.647376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a1f32-4373-4551-ad06-9e3b0945740a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.648938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.681511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.682196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.682680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.683113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] PATH_INFO: `/v3/groups/63a389c09bb94d83ad7ed710d5e2c890` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.684531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] RBAC: Authorizing `identity:get_group(group_id=63a389c09bb94d83ad7ed710d5e2c890)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.685992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.687555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 227/452] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/groups/63a389c09bb94d83ad7ed710d5e2c890 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:27.692329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.694015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.745840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d211b-6462-4d04-9735-7b9e8d5dbae8 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.780181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.780833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.781100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.781368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] PATH_INFO: `/v3/groups/f03eeb17f2f1467083bba431409fe7f3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.782536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] RBAC: Authorizing `identity:get_group(group_id=f03eeb17f2f1467083bba431409fe7f3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.783988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.785578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 226/453] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/groups/f03eeb17f2f1467083bba431409fe7f3 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.791337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:27.795487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83f9e-a9a7-4062-bcea-7d9ee718b732 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.830391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.830986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.832801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] RBAC: Adding query filter params (group.id=63a389c09bb94d83ad7ed710d5e2c890, role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=9a304260abbd4fa38198d15914f9035c) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.833103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.834551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defc44-8b0a-43dc-9df2-f76da7090303 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.840514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 228/454] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/role_assignments?group.id=63a389c09bb94d83ad7ed710d5e2c890&scope.project.id=9a304260abbd4fa38198d15914f9035c&role.id=bde35209edd64a3187d196af53f70e5d => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:27.895876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c2523-054c-4701-b49a-2021662a2549 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:27.911093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:27.935558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:27.936185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:27.936469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:27.936745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:27.937491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] RBAC: Adding query filter params (group.id=f03eeb17f2f1467083bba431409fe7f3, role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=b8101feb5c7e451b867c922095e58411) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:27.937831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:27.939284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13198c6-80db-41af-96a4-5b3a1bc3297d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:27.946630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 227/455] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Aug 24 03:26:27 2022] GET /identity/v3/role_assignments?group.id=f03eeb17f2f1467083bba431409fe7f3&scope.project.id=b8101feb5c7e451b867c922095e58411&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:30.435680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9726a5-9cd9-4ed6-a408-e4fc61a9ac8f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.436198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9726a5-9cd9-4ed6-a408-e4fc61a9ac8f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.436304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9726a5-9cd9-4ed6-a408-e4fc61a9ac8f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.438086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 229/456] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:30.450502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec916a89-c3f6-445c-a4af-0f3ab1bba7a5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.450977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec916a89-c3f6-445c-a4af-0f3ab1bba7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.451050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec916a89-c3f6-445c-a4af-0f3ab1bba7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.475268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ec916a89-c3f6-445c-a4af-0f3ab1bba7a5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:30.476489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ec916a89-c3f6-445c-a4af-0f3ab1bba7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.580335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 228/457] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:30.623605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea3665-1edf-4d51-967e-c5fff70238e8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.624258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea3665-1edf-4d51-967e-c5fff70238e8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.624829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea3665-1edf-4d51-967e-c5fff70238e8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.626651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 230/458] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:30.631623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4e70-d120-4eaa-8089-06792b1c1e1a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.631914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4e70-d120-4eaa-8089-06792b1c1e1a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.632191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4e70-d120-4eaa-8089-06792b1c1e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.658763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c46d4e70-d120-4eaa-8089-06792b1c1e1a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:30.660500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c46d4e70-d120-4eaa-8089-06792b1c1e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.744302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 229/459] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:30.752828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4d23-4017-411b-9105-49f275816f38 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.753315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4d23-4017-411b-9105-49f275816f38 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.753746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ed4d23-4017-411b-9105-49f275816f38 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.756614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 231/460] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:30.761092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:30.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:30.761666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:30.783431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:30.785165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:30.815880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:30.864821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 230/461] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:30.937102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4d23-4017-411b-9105-49f275816f38 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:30.986233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.073519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ed4d23-4017-411b-9105-49f275816f38 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.121245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.121915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.122196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.122470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.133836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.135309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:31.163424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:31.164416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:31.165336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:31.165336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.165336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:31.165336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 232/462] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:31.171242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.176203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.282466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.301856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab8cfc-2301-49c9-98a8-130992bf7e91 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.341172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.342177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.342665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.343145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75328a2e-85d7-4e37-8102-45577d76aab5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.343288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.344007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:31.344416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.346047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.365516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 233/463] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:31.371052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.388393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.389578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.390062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.390543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.402216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.403679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:31.419711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:31.420724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:31.421584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:31.421584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.421584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:31.421584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 231/464] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:31.421584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.442467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.484734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f024e-aa3f-4932-aa2f-3ecc60f33f09 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.525488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.526664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.527021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.527351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.538381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b1c4-a051-4ee4-b86f-6f4422d56270 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.539186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.540907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.547904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-44f97986-6ef8-4d1d-829e-694e43dba9b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:31.556602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:31.557626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:31.558543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:31.558543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:31.558543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:31.562897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 234/465] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:31.564097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32438b4-da19-42f2-8736-525ea7cdeb5c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.564386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32438b4-da19-42f2-8736-525ea7cdeb5c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.564669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32438b4-da19-42f2-8736-525ea7cdeb5c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.566560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 235/466] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:31.567325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32438b4-da19-42f2-8736-525ea7cdeb5c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.580388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.581635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.581953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.582227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.582878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.584404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.689214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 232/467] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/users => generated 246 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:31.689214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.691955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32438b4-da19-42f2-8736-525ea7cdeb5c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.744493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.745222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.745505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.745804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.746517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:31.746881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.748324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99eaf3d-74a7-499b-9b04-05cd7f243d38 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.767602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 236/468] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.767602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.767602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.767602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.786890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:31.788021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:31.811157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.849597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f58a9c-eb1a-4f29-a25b-73147898afe3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:31.853091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:31.871644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 237/469] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:31.872479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:31.889003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:31.890006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:31.890483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:31.891037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:31.891965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:31.892438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:31.895039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:31.910467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 233/470] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:31.916746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.006947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72cb58-b72f-4e3a-9acd-cb52627160bd None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.037967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f769f-a200-48bc-afdd-5e16f1f98d6d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.041887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a683b9-2622-4483-b92a-f0c11e28ef04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.042550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a683b9-2622-4483-b92a-f0c11e28ef04 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.042824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a683b9-2622-4483-b92a-f0c11e28ef04 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.043096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a683b9-2622-4483-b92a-f0c11e28ef04 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.043739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a683b9-2622-4483-b92a-f0c11e28ef04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.045401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a683b9-2622-4483-b92a-f0c11e28ef04 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.076763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.077460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.077804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.078095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.078735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.080247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.088800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.198038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 238/471] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/users => generated 248 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:32.198526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 234/472] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:31 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:32.199442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a487f2-00ce-4807-8682-30dd93aa0179 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.199736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a487f2-00ce-4807-8682-30dd93aa0179 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.200013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a487f2-00ce-4807-8682-30dd93aa0179 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.201392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 239/473] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:32.206228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.212606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.212970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.213320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.241155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:32.242715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:32.312493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.380893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee3987-78e7-4fe1-80a6-6e607d8538e4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.398162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 240/474] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:32.432326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.433311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.433909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.434376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.446877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.448539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:32.464326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:32.465515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:32.466605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:32.466605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:32.466605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:32.468025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 235/475] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:32.474173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.589871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd4751-ccda-4e0f-b973-22242de58340 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.626209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.627080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.627496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.628456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.629232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:32.629679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.631325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.644148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 241/476] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:32.649607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.672197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.728039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.728263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:32.807958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0f0e-b6fa-4b6b-bdca-db0372a8ba5a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.850645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec81a-3c48-48fb-8246-0d5523388a0d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:32.856186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.856811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.857091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.857358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.858052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.859477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.903303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:32.903924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:32.904262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:32.904547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:32.905219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:32.906636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:32.940506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.sql.core [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:26:32.940506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:26:32.940506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [parameters: {'id': '843a20bd4de54d16a6902ff2f14482de', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:26:32.940506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81788) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result.read() Aug 24 03:26:32.962260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:26:32.963189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application yield resource Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise self.value Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application session.commit() Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:26:32.964167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:26:32.965065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:26:32.966023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result.read() Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:26:32.966858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [parameters: {'id': '843a20bd4de54d16a6902ff2f14482de', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:32.969522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 03:26:32.974773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:32.976800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 242/477] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 24 03:26:32 2022] POST /identity/v3/roles => generated 144 bytes in 292 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:32.976800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:32.981933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 236/478] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:32 2022] POST /identity/v3/users => generated 249 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:33.136933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.140899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acab4c1-021c-43ce-a0ba-b44dcee42d8c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.193887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123b003-c78c-45dc-8c49-38c4812588da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.194521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b003-c78c-45dc-8c49-38c4812588da None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.194800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b003-c78c-45dc-8c49-38c4812588da None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.195071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123b003-c78c-45dc-8c49-38c4812588da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.211085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123b003-c78c-45dc-8c49-38c4812588da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-9123b003-c78c-45dc-8c49-38c4812588da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:33.215775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:33.216675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:33.217911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 243/479] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:33.229228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:33.359212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:33.364475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941fdc0-aea6-42e1-b33d-15c9ecf96cfd None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:33.411564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:33.412149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:33.412402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:33.412676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:33.413354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:33.413703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:33.415138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842bb015-ada1-4608-8cfb-7017a78e8432 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:33.432212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 237/480] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:34.243887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e80a-b1fe-4e6b-92d2-a52724b343f7 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.244626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e80a-b1fe-4e6b-92d2-a52724b343f7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.244626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e80a-b1fe-4e6b-92d2-a52724b343f7 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.246607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 244/481] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:34.253290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e137b1-18d6-4483-82b7-78ccdec10c48 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.253937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e137b1-18d6-4483-82b7-78ccdec10c48 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.253937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e137b1-18d6-4483-82b7-78ccdec10c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.277440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-32e137b1-18d6-4483-82b7-78ccdec10c48 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.278681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-32e137b1-18d6-4483-82b7-78ccdec10c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.368135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 238/482] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:34.632960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03c3c-1a2e-4b82-9c50-a83934b29fcd None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.633323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03c3c-1a2e-4b82-9c50-a83934b29fcd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.633486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb03c3c-1a2e-4b82-9c50-a83934b29fcd None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.635099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 245/483] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:34.647870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.648161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.648442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.674818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.676047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.728525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d229-50e7-4a6f-a63d-30466ae38f4d None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.728828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d229-50e7-4a6f-a63d-30466ae38f4d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.729072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8d229-50e7-4a6f-a63d-30466ae38f4d None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.730655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 246/484] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:34.739369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:34.739651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:34.739924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:34.766798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:34.768530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:34.781971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 239/485] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:34.841848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:34.870158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:34.874175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 247/486] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:34.993658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b19af3-9492-4563-a551-2c42667702ce None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.028542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.029179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.029461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.029734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.041274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:35.046099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.047771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:35.048581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:35.050957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 240/487] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:35.054881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.078271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.197019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.222922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd88dd8-419c-4fad-adf4-c5a869d68ecf None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.235520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.261580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0c0c-f4f7-4316-921b-56464a7dea5b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.289258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.291039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.291332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.291606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.292366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.292671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.294506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.295066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.295624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.296279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.296905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.309607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 248/488] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.309607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.318876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:35.325991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.326882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:35.327690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:35.331147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 241/489] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:35.332200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.440649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce277d-cca3-4525-a67c-5a5d1f44040d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.450319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e17dbd-4c33-4537-a7c8-022737249b57 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.479700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.480447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.480826 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.481279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.492541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:35.497906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.499003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:35.500039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:35.502035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 249/490] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.503438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.503591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.504495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.504920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.505373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.515707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.517248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.520564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.522248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:35.538208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.539187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:35.540051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:35.540051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.540051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:35.541818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 242/491] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.542791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.624901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f8f65-2115-4099-b958-6542a8bbbd5a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.657237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097998c-a8b3-4ebe-8249-f5a692b539e1 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.670993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.672262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.672946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.673391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.674649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.675134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.677056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.689061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 250/492] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.690714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.702496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.703001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.703284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.703553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.704221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.704525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.706481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b92e-34cd-4aec-9b7d-bc3ed073139a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.720155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 243/493] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.720155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27bbb-f9e2-4643-9058-9a693809067d None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.720155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27bbb-f9e2-4643-9058-9a693809067d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.720155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27bbb-f9e2-4643-9058-9a693809067d None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.720155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 244/494] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:35.720155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27bbb-f9e2-4643-9058-9a693809067d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.781381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.784788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:35.819977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9820f-f3bf-4f73-9060-7f933ee84968 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.832907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27bbb-f9e2-4643-9058-9a693809067d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:35.872325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.873073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.873528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.874014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.875048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:35.875558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.878304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.887976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:35.889269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.889734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.890205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.902936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 251/495] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:35.902936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:35.908632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:35.910130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-d78aa36b-f02c-4a15-9eb2-5fc3854d29b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:35.924590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:35.925541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 245/496] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:35.931435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:35.946506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:35.947807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:36.020041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 246/497] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:36.021334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.023020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ce064-3e31-496d-9377-f7a549ea3479 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.058563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.066648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.074209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.075423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.075907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.076381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.091409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.093902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:36.110966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.112193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:36.113072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:36.113072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:36.113072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:36.113907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 252/498] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.114912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.166231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbf11c-abe9-4937-830b-32fe83185366 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.207281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.207910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.208184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.208451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.217479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.219114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.226113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23483058-2f8a-4931-88a1-1b5ccca480b5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:36.232417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.233381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 247/499] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.234372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.273356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.275064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.275498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.275922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.276715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.277190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.279172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6a6e0-9385-4a81-85b6-c94b5329fa7a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.293294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 253/500] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.295233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815d15-0fdb-4614-b3e1-83e5f4b53b33 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.295673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815d15-0fdb-4614-b3e1-83e5f4b53b33 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.296119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815d15-0fdb-4614-b3e1-83e5f4b53b33 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.297481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 254/501] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:36.298374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815d15-0fdb-4614-b3e1-83e5f4b53b33 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.339708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.345313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632db326-ae34-4d75-ac71-df37c52ee581 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.346415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.380925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.381529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.381836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.382106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.382744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.383043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.384426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.396505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 248/502] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.397333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.402109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815d15-0fdb-4614-b3e1-83e5f4b53b33 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.435748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.436354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.436634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.436906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.437633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.437961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.439387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.475681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 255/503] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.476530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.498616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279e17b-acfa-4938-a5aa-434733a4acd3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.534984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c2657-2aef-4047-8ec4-01a45199138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.535196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c2657-2aef-4047-8ec4-01a45199138e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.535400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c2657-2aef-4047-8ec4-01a45199138e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.535669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c2657-2aef-4047-8ec4-01a45199138e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.545993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c2657-2aef-4047-8ec4-01a45199138e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-d34c2657-2aef-4047-8ec4-01a45199138e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:36.550747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.551721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:36.553085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 249/504] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.553971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.553971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.553971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.571726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:36.572939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:36.579848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0750060-4125-4221-9a5e-e87f7ec291c4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.582147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.584973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.616208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.616860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.617454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.617727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.625030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.626555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:36.640213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.641213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 256/505] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.642182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.652448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 250/506] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:36.653263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.755394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3015-16d7-43ee-ae5f-08c3241f1550 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.771727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52679e96-12b4-4be8-87bd-1d1f9bebdade None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.791035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.791668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.791953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.792232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] PATH_INFO: `/v3/users/glance` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.801576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.803086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.807289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.807897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.808174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.808465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:36.816172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:36.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:36.818044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 257/507] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:36.818610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:36.830025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.847653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:36.886641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.888022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.923852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6e89-84b6-4698-90eb-7267bfecf8df None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:36.957852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:36.958461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:36.958740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:36.959013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:36.959941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:36.960249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:36.961617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:36.969556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 258/508] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:36.970397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.003528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 251/509] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:37.004407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.052285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.061102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.077085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda6443-0560-4e6e-8a29-845454d683ef None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.105173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb3305-759c-4d65-a6c3-e5d11ca29015 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.110942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.112131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.112405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.112672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.113401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.113698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.117243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.132465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 259/510] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.133382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.140792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.141352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.141635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.141943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.142688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.143027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.144470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.181113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 252/511] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.181990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.239566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004e26a-f896-4c3c-a1a3-e8556689227b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.273635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.274288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.274569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.274834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.285608 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.286863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3badf1-4d0d-4552-83d7-ace533df675a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.287075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.288993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.289383 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:37.303541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.306434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:37.307308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:37.307308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.307308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:37.307308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 260/512] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.307308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.322756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.323430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.323982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.324487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.335145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.336612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:37.351387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.352862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:37.353728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:37.353728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.353728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:37.353728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 253/513] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.353728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.411273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611763d-4b3d-40b4-bd28-29bd4f7e35c7 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.444714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.445339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.445618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.445926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.457548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.458628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c91ad-fbb6-4a30-8930-7813616ed6bb None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.459062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:37.478665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:37.479787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:37.480849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:37.480849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:37.480849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:37.480849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 261/514] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:37.484943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.496596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.497211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.497490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.497790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.523138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.531394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.566173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.567665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.585704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae614e36-83f5-499d-8208-b4da73287e89 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.620189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.620785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.621060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.621335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.668153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 254/515] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:37.668937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.695740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.697283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.734075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.744700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.780120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab6e9c-5155-48db-8266-99ad7b640993 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.799961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 262/516] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:37.800815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.819856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.820459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.820737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.821007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.821649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.821981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.823337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.835002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 255/517] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.835815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.904146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e13557-49e8-42f5-9caf-c067100b6908 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.933186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410600c-e1af-4f01-bc64-e5a847f8b9db None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:37.938017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.938626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.938906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.939181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.940410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.940724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.942104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.949924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.953256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 263/518] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.954236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:37.963336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:37.967808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:37.968422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:37.968705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:37.968980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:37.969687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:37.969966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:37.971342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:37.984069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 256/519] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:37.984892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.056849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809154c-e6e0-4fd5-a68c-77a95a600509 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.085105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea609b-2594-4958-81c3-045d994b7a76 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.090507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.091138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.091423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.091685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.103174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.104626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:38.119398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.120511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:38.121393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:38.121393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:38.121393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:38.121560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.121655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 264/520] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.121725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.121725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.121725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.121969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.133101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.134606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:38.149201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.150359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:38.151450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:38.151450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:38.151450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:38.151450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 257/521] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.151450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.180088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.183776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.225714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4adb3-62ef-4a2e-9086-1593f70094c1 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.253219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b52b5-daf6-4ec5-85f8-964a10d9b0a0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.260757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.261366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.261637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.261936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.262573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.264015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.287799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.288413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.288692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.288958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.295945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.297399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:38.313402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.317524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 258/522] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.318699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.352415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 265/523] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:38 2022] POST /identity/v3/users => generated 247 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:26:38.353281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.416958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.430772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9288e-f349-4264-8e11-ad714cfa6513 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.471036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.471780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.472163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.472539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.479948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2938be-4f3f-4b17-bfca-5d5b19a1ea4d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.480736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.482595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.496598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:38.497648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.498592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 259/524] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.499588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.525686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.526520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.526827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.528026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.528141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.528524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.530304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.544088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 266/525] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.545150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.630580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df61a84-c6e8-473a-aafe-e1dd89641b18 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.666234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88737-0ace-40ea-86b7-97f101ce61c4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.670214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.670937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.671321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.671692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.672449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.672873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.674467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.686437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 260/526] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.687373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.699031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.711220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.716578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.716578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.716578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.716578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.716578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.716578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.738693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 267/527] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.738693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.767526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:38.808852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841992a-6c8e-4442-9f11-f7d888bcbbf7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.843920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6014-fe90-4d6f-a5d2-ef8cd1eec422 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:38.845566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.846317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.846600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.846930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.847675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:38.847946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.849406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.873280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 261/528] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:38.874200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.892457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:38.894001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:38.894419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:38.894850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:38.904101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:38.905546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:38.929349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:38.930820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:38.931929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:38.935377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 268/529] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:38.936360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:38.963961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.004565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110014b7-4a4c-4341-b0c0-b993b8b81431 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.044736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.049938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.049938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.049938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.051605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.055155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.056738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.060042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23afa7e-a2a8-4865-8edd-218b4fa2cb2b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:39.069333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:39.070457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:39.071689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:39.072770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 262/530] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:39.073109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.100168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.101118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.101707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.102663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.177907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.179412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.181924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8272a-8041-41fd-8a41-51bf4188be59 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.211853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.219888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.220503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.220980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.221128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.221832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=afdf5eda0a634fe48781ef984f7bf496) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.222147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.223619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.236996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 263/531] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/role_assignments?user.id=afdf5eda0a634fe48781ef984f7bf496&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.236996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.318298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.333566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 269/532] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:39.335157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.353621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee601df-59a5-4b5a-837b-56cf8d45c352 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.395737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.396362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.396672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.396945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.397643 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.398645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.400118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.417811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 264/533] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.417811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.460661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063f0ec-f649-455c-9b65-ea2470aa2e7c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.481147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.504752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.505517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.505893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.506222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.507187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.507682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.509227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.529728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 270/534] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.536131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.538634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9adb5-3e9d-4e18-bc47-557d2f3d4bad None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.578549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.579109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.579394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.579670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.591908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.593465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.602194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:39.609273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:39.610256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:39.611124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:39.611124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:39.611124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:39.615113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 265/535] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:39.616069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.654248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd073e1-a235-4c9b-aa65-4338c73f598d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.692040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.692663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.693007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.693285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.694068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=db35ea7cc80d49caa8187dcde2d55642) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.694384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.695840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.702309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 271/536] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/role_assignments?user.id=db35ea7cc80d49caa8187dcde2d55642&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.703254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:39.729100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db094d0-fd76-44bc-9c6f-44e812cea4e9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.731746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.787870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.788879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.789354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.789878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.790800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=fc5b05e5e96a4afc95ab176576b92577) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.791316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.792955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.807517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 266/537] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/role_assignments?user.id=fc5b05e5e96a4afc95ab176576b92577&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.844561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979032d8-0cd9-4920-bade-806e06040e59 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:39.864415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:39.891763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:39.892410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:39.894468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:39.894788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:39.895472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:39.895785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:39.897302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:39.911317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 272/538] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:39.917152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.045818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08cdf-c636-4cc4-9baf-f000dc6c9625 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.087390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.088040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.088322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.088629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.095941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.097415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:40.109306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:40.110240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:40.111101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 267/539] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:40.116774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.249188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722f87b-1e44-4e43-ae85-d649dbfedcfa None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.293071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.293687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.293994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.294263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.294963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:40.295265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.296708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3019680-83b5-45ab-8a41-17d707d474b3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.309480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 273/540] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:40.315591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:40.362187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.447479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b423-cc59-4847-afab-c6051381d637 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.447479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b423-cc59-4847-afab-c6051381d637 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.447479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49b423-cc59-4847-afab-c6051381d637 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.447814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0963f0-2677-40ea-9411-489aeb9a5e52 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:40.448215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 274/541] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:40.454711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.454711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.454711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.472645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:40.473908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:40.512668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:40.514239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:40.514575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:40.514855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:40.515617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=21235d5078fc408da2d9f4e35ab51a79) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:40.515926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:40.517435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:40.527030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:40.531581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 268/542] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/role_assignments?user.id=21235d5078fc408da2d9f4e35ab51a79&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:40.603238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 275/543] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:40.944743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.053522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.062804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d06b-c306-424a-8f46-f86f0d088b8d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.182570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.183572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.184048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.184519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.203628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:41.209311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:41.210477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:41.211287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:41.213575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 269/544] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:41.219636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.401970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0afd7-726b-427c-a133-a4e8e475a5d9 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.439818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.440784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.441255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.441718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.442705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.443199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.445048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a98277-1d46-4da9-9d39-28f2f85e7ad0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.454496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 276/545] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.463149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.541890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4493-b032-4253-8c1f-2d9b21451689 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.542397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4493-b032-4253-8c1f-2d9b21451689 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.542473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a4493-b032-4253-8c1f-2d9b21451689 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.543811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 277/546] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:26:41.549390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.549688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.549996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.570834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:41.572027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:41.607737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:41.616406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936336c2-0c8a-4884-8437-bdcf3bb01c9d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.672716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 278/547] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:41.690556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.691208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.691486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.691757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.713938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.715338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:41.742071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:41.743145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:41.744619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:41.744619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:41.744619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:41.744619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 270/548] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:41.749006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.881509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bbfca-7e07-48b2-a837-e16865bd107c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:41.922545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:41.923173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:41.923475 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:41.923717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:41.924364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:41.924664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:41.926044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:41.942285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 279/549] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:41.947744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:41.963815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.091463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14690b4-3588-425a-9605-162640d3bfbf None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.109794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.134888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.147627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.148276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.148561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.148810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.158037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.159516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:42.183492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.185715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:42.188224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 271/550] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.200483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.297874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2954ea-f2c7-4231-b1e9-4b2362b0bcc0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.331424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.353395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975c25a-f401-44c1-be26-3f0f6a9bceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.354108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975c25a-f401-44c1-be26-3f0f6a9bceb0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.354385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975c25a-f401-44c1-be26-3f0f6a9bceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.354654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975c25a-f401-44c1-be26-3f0f6a9bceb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.371148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975c25a-f401-44c1-be26-3f0f6a9bceb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:42.377806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f335a-867b-4ace-a85b-a55bb806dbb0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-5975c25a-f401-44c1-be26-3f0f6a9bceb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:42.378958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.380960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:42.382415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:42.386232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 280/551] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.387724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a1ef5-7886-4a0f-bb94-6fc2b27a8dd6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.388030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a1ef5-7886-4a0f-bb94-6fc2b27a8dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.388306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a1ef5-7886-4a0f-bb94-6fc2b27a8dd6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.394835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 281/552] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:42.395513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a1ef5-7886-4a0f-bb94-6fc2b27a8dd6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.428319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.428933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.429211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.429505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.430259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.430663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.432084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9565b-2deb-4e16-80be-1f070fcba66b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.455999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 272/553] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:42.455999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b1f5-cc38-4493-9b8d-7f4109e5c4c1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.455999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b1f5-cc38-4493-9b8d-7f4109e5c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.455999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6b1f5-cc38-4493-9b8d-7f4109e5c4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.475354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c5a6b1f5-cc38-4493-9b8d-7f4109e5c4c1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:42.477906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c5a6b1f5-cc38-4493-9b8d-7f4109e5c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:42.500864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.528157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a1ef5-7886-4a0f-bb94-6fc2b27a8dd6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.551432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 273/554] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:42.552867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa386dc-ac80-47da-b919-12495a192479 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.553153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa386dc-ac80-47da-b919-12495a192479 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.553430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa386dc-ac80-47da-b919-12495a192479 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.557807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 274/555] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:42.557807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa386dc-ac80-47da-b919-12495a192479 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.573110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.573920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.574275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.574617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.575519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:42.575832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.577433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b2aa3-6669-4ea8-b69e-9d9e60af191b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.587224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 282/556] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:42.588471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.588804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.589159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.609292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:42.610512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:42.631271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.689201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa386dc-ac80-47da-b919-12495a192479 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.698997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 283/557] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:42.700231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.762500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.763123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.763420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.763951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.782691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.817158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d715d-74f9-4e1d-996a-0caf139a3252 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:42.855257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.856708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.856946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:42.857587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.857907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.858184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.872838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:42.874421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-fc194769-e347-47ed-b477-855f7b6b1116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:42.892808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:42.893818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:42.894729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:42.894729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:42.894729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:42.894729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 284/558] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:42.895499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4324-ef75-4ed8-97d3-845f30e8150b None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:42.895499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4324-ef75-4ed8-97d3-845f30e8150b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:42.895667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4324-ef75-4ed8-97d3-845f30e8150b None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:42.897006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 285/559] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:42.897555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4324-ef75-4ed8-97d3-845f30e8150b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:42.920884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:42.975873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 275/560] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:42.977063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.009473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4324-ef75-4ed8-97d3-845f30e8150b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.032306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.044522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37b7dc-1809-40ab-80da-a1b14d09098a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.045155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b7dc-1809-40ab-80da-a1b14d09098a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.046798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b7dc-1809-40ab-80da-a1b14d09098a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.046798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37b7dc-1809-40ab-80da-a1b14d09098a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.056360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37b7dc-1809-40ab-80da-a1b14d09098a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-2b37b7dc-1809-40ab-80da-a1b14d09098a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:43.061130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.062156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:43.063009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 286/561] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.063961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.064272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.064582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.083193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:43.083553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab923b0-b9a7-44d4-bd50-7df3979d1319 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.085390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:43.174532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 287/562] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:43.175307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.175874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.176492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.176774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.177044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.177688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.178021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.179408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.193921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 276/563] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.197613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.213318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.285790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93db70-7e04-40a4-9c03-cd775a0cd0eb None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.299446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.299841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75e544-c846-4941-944c-d7c9ce7027fd None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.324333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.324971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.325257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.325529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.337728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.338869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.339212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.339509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.339797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.340072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.350868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:43.354101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.355147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:43.356055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:43.356055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.356055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:43.356055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 288/564] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.356304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:43.357883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.358880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:43.359720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:43.362848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 277/565] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.363826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.439812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.466242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f535ca0-5ff9-4864-a344-192a84aa3bf0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.473943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbeb68-ebec-47d4-b1be-e576109587eb None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.499546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.500156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.500437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.500716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.501382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.502254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.503627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.509731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.510396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.510676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.510952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.511659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 289/566] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.512492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.522889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.524332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:43.535706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.536709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 278/567] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.537663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.543245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.617156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab96b96-50d8-4c31-92fb-4e4116828b95 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.642805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ba3be-8727-4bdf-a50a-28185fd6f57c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.652075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.652681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.652963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.653234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.653908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.654234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.655570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.666546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 290/568] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.667355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.671792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.677015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.689005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.689005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.689005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.689005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.689005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.689005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.690096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 279/569] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.690375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.756554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.773584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59819f99-64b0-4517-a11d-5f54051cf2c2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.804189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aa46d-55a3-4e2a-abc4-495eaee6e5e7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.818297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.818930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.819260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.819483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.829477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:43.834433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.835377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:43.836237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 291/570] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.836941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.843545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.844181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.844462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.844731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.854923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.856371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:43.871310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:43.872280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:43.873189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:43.873189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:43.873189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:43.873189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 280/571] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:43.873189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:43.920815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:43.940481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070fd0a-d36c-46a6-87ed-3d3210d0e13f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.973706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7916e-1265-4306-8715-c132fb1b4768 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:43.975394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:43.976009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:43.976288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:43.976578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:43.977308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:43.977616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:43.979109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:43.995857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 292/572] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:43.996676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.000169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.011254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.011813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.012094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.012418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.019600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.021052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:44.032209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.034074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 281/573] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.035015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.153487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc17e-f2fd-470f-818e-fca318d61a4d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.153976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb5e9a-01d2-483a-a4a8-9e9c886bd379 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.161294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.187968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.188600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.188881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.189704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.189957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.190861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.191268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.191939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.193267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.193587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.195099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.199838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.201266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.203520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 282/574] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.204333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:44.222111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.223327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:44.224507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:44.224507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.224507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:44.224507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 293/575] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.224507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.280800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.311421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc5e08-0361-4ba7-b716-d0915d4fe4b5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.323978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3785628-4e3c-4e0f-a10c-ac4e83dc73f6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.346375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.346981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.347264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.347536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.348175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.348477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.349885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.358145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.358774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.359050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.359321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.361925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 283/576] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.362725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.375258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.376724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.390520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:44.391852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.393367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:44.394328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:44.394328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.394328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:44.394328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 294/577] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.394328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.468021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de0810-4112-48cf-8700-780cd6e56b1d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.498402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee3c05-486c-4562-ad0b-6a309c546022 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.504555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.505160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.505438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.505704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.506422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.506724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.508062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.508161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.520301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 284/578] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.521124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.534142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.534768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.535043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.535313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.545456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.546936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:44.561888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.562985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:44.563930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:44.563930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:44.563930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:44.563930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 295/579] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.564238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.613293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.625256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051df09d-cea0-48c2-8b86-3694c3c2800f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.660668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.661275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.661556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.661857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.662505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.662810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.664174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.666192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed314825-c13a-45ee-9561-f67a7554b2dc None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.675873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 285/580] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.676677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.700069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.700701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.700977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.701249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.709369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.710861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:44.722377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:44.723586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 296/581] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:44.724584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.745457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.779632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e3810-f2b2-41a0-bafd-03b848f0f789 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.815561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.816172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.816455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.816729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.817373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.817677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.819082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.824928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2f8d-c06e-4ea2-84a1-b1d958d0f982 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.830961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 286/582] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.831795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.842639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.863263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.863874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.864150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.864443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.865190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=86600b9afdbf43808b4745828a1d3756) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.865521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.866964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.872350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 297/583] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/role_assignments?user.id=86600b9afdbf43808b4745828a1d3756&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.873156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:44.938379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8243e4-ac54-494e-8aaa-61c57b46159f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:44.978077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:44.978606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:44.978893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:44.979170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:44.979838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:44.980148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:44.982248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:44.993702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:44.996803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 287/584] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:44.997688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.020829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e788aaa0-fef2-49f5-9319-b673c45445ae None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.061096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.062049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.062331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.062605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.071475 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.072918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.076115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:45.085590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.088407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 298/585] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.089408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.118873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46c177-7a4b-4b68-9c07-b1643d576ebc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.158006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.158626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.158906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.159174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.159905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.160206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.161639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.181487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 288/586] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.182368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.209872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63902dc4-3368-407b-8bbf-5ce7339d9f10 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.247217 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.247927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.248326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.248609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.256518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.258161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:45.270654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.276554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 299/587] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.277798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.279816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.296674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ed00b-cc90-43f3-aba6-0130ce958edb None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.325973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.335134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.335849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.336199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.336594 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.343819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.345300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:45.357364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.358892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:45.360082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:45.366162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 289/588] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.366162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.396991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6ee6-a51f-493b-9f1f-1044600b76ac None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.438121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.438831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.439216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.440064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.440863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.441237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.442761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.470181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 300/589] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.470181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.480902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0037a-3850-4582-9571-d317896a95ec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.517823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.518375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.518657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.518933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.530406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.531859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.537941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:45.547163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.552741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:45.554182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:45.554182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:45.554182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:45.554182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 290/590] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.554182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.582614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f0b26-0034-4409-8c5a-218c3aac2eef None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.592368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.620710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.621316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.621595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.621895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.629932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.629932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.629932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.642636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 301/591] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.642636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.656425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba2e96e-a937-456d-b23d-de9ce822f2a6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.694634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.696266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.696266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.696266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.696534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.696895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.698268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.716668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 291/592] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.717513 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.764322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac627ed9-f00a-4bb2-a7dd-04464865c857 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.800383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.813670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.814376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.814660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.815007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.825958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.827406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.829745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:45.836402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e400364-4c22-4581-aec9-f132866ff28c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:45.846133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:45.847265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:45.848444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:45.848444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:45.848444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:45.849176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 302/593] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:45.850272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.878488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:45.879121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:45.879487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:45.879825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:45.880549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:45.881165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:45.882396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:45.897732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 292/594] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:45.898753 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:45.968976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3d079-557f-4314-a57c-8794926d2ab8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.008350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26ce51-7fda-42e6-b7aa-5367dc3e5b0e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.018356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.019333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.019759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.020291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/afdf5eda0a634fe48781ef984f7bf496/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.037501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=afdf5eda0a634fe48781ef984f7bf496, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.039002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.047259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.047794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.048156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.048455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.059650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.061034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:46.074976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.076117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:46.077237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:46.077237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:46.077237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:46.077237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 293/595] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:46.077237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.092486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.118675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 303/596] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:45 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/afdf5eda0a634fe48781ef984f7bf496/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:46.130968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.178466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.204005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a166f5-b435-46a5-8400-89b57a4a9422 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.254687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.255886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.256719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.257170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.258015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.258474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.260733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.277256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34068ea0-04bd-4e55-b33b-ee767fc038bc None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.279525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 294/597] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.281496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.325664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.326622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.327083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.327340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.337800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.338864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:46.354750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.355928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:46.357129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 304/598] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:46.360560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.378465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.414907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59682255-aaf3-48e1-98a0-9e21d0963d9c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.459423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.460191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.460568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.460931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.461701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.462119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.463604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.468432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.481688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 295/599] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.482689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.486407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5bb94-3091-483d-ba91-2a961933698a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.524843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.525725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.526195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.526678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.534022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.535716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:46.547416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.548419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:46.549346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:46.551464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 305/600] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:46.552669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.596031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e84d5-f02e-4b55-ab60-692dd9527960 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.623540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.633255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.633901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.634183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.634453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.635185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.635486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.636917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.649674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 296/601] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.650541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.666589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f987e-3175-4960-bb59-8dbfe7e36786 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.708256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.709698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.710283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.710756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.723258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.725097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:46.738119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:46.739116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:46.740050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:46.742502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 306/602] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:46.743565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.747682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.772218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f6ad-78d9-4d72-ab3b-1fad7c26b255 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.809996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.810660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.810981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.811268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.811978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.812290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.814653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.826966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 297/603] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.829826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:46.860224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b950fff-b095-4019-b9d6-402ca7ad7cc6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.882926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:46.897145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.897999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.898282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.898554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/fc5b05e5e96a4afc95ab176576b92577/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.913605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=fc5b05e5e96a4afc95ab176576b92577, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.915211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.936245 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2ea34-4d64-41e8-9d33-d77582f83a90 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:46.970314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:46.970922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.971208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.971480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.972170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:46.972475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:46.973920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154175f-ecdd-4aa4-93c8-23087e158ae6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:46.986301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 298/604] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:46.987527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf07509-5090-46a6-8d39-e5d967dcfcff None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:46.987815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf07509-5090-46a6-8d39-e5d967dcfcff None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:46.988089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf07509-5090-46a6-8d39-e5d967dcfcff None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:46.989555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 299/605] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:46.991893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf07509-5090-46a6-8d39-e5d967dcfcff None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.009819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 307/606] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:46 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/fc5b05e5e96a4afc95ab176576b92577/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:47.009819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.081648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.149489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af05507-a6f3-4326-a557-1371498b62b3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.172876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf07509-5090-46a6-8d39-e5d967dcfcff None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.189214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:47.197848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12c294-fb14-4c65-8958-3189ac53c5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.198859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c294-fb14-4c65-8958-3189ac53c5e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.200761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c294-fb14-4c65-8958-3189ac53c5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.200761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12c294-fb14-4c65-8958-3189ac53c5e3 None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/21235d5078fc408da2d9f4e35ab51a79/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.216570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12c294-fb14-4c65-8958-3189ac53c5e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=21235d5078fc408da2d9f4e35ab51a79, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.218066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12c294-fb14-4c65-8958-3189ac53c5e3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.226086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.226791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.227071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.227343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/db35ea7cc80d49caa8187dcde2d55642/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.247688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=db35ea7cc80d49caa8187dcde2d55642, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:47.249198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:47.330096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 308/607] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:47 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/21235d5078fc408da2d9f4e35ab51a79/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:47.331722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.332010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.332284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.353344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:47.354677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:47.402605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 300/608] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:46 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/db35ea7cc80d49caa8187dcde2d55642/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:47.461723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 309/609] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:47.776639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:47.923704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd940f4-5149-4d3d-9051-634dc85258e7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:47.969541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:47.970244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:47.970526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:47.970800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:47.981559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:47.986316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:47.987342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:47.988206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 301/610] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:47.994880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.046214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.125799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a941c-1c43-4cd2-8b24-1031730dfb1c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.163218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.163829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.164106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.164378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.165046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.165346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.166731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b026d-9d8d-4ddd-b3d2-f097800c5456 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.176305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 310/611] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.181790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.203549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.305707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13988beb-43ee-4794-b2b2-24e9b951d471 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.351317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73347c3-e756-402a-9752-4d0eef5b5013 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.351621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73347c3-e756-402a-9752-4d0eef5b5013 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.351871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73347c3-e756-402a-9752-4d0eef5b5013 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.352773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.353404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.353683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.353978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.357060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 311/612] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:48.358544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.358828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.359103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.365296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.366784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:48.382910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:48.383922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:48.384879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:48.384879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:48.384879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:48.384879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 302/613] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:48.390977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.418801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:48.419994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:48.481593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.515628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90e13c1-99df-4239-881d-f96511171606 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.551715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.552326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.552604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.552872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.553628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.553951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.555320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.568572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 303/614] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:48.574081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.583399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 312/615] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:26:48.691103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02600229-2fa0-4fde-8444-ec3cc23fadbf None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.722173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.734588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.735183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.735469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.736296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.744150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.745585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:48.757805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:48.758827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:48.759789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 304/616] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:48.766906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.814661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:48.912665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:48.914306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa488ff5-9fb4-4a8f-8630-2329a4f3c9a7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:48.949685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:48.950329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:48.950610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:48.950884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:48.951614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:48.951918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:48.953364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:48.972925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 313/617] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:48.982736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.109389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d1de-04af-4666-8bc4-e7cce6a947f7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.153445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.169599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8792f-c9ea-4c0f-b395-81ed203b0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.170611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8792f-c9ea-4c0f-b395-81ed203b0ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.171113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8792f-c9ea-4c0f-b395-81ed203b0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.171607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8792f-c9ea-4c0f-b395-81ed203b0ad4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.181589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa6973-607c-4260-9fe2-00cc59dcb84a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.183912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8792f-c9ea-4c0f-b395-81ed203b0ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-84e8792f-c9ea-4c0f-b395-81ed203b0ad4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:49.189212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.190263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:49.191126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 305/618] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.191993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca484c90-4203-43f4-82ce-152e6bff5c3f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.192550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca484c90-4203-43f4-82ce-152e6bff5c3f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.192550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca484c90-4203-43f4-82ce-152e6bff5c3f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.198042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 306/619] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:49.199053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca484c90-4203-43f4-82ce-152e6bff5c3f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.230750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.232045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.232637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.233605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.248001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.250374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.260961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d1fb3a4e-abce-471f-ac48-aa87246f6927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:49.273785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.279105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 314/620] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.280066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.306293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:49.308461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:49.321454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca484c90-4203-43f4-82ce-152e6bff5c3f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.361533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.362211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.362504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.362775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.363443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.363744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.365179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.374690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 307/621] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.375678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.403641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 315/622] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:49.404906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.503296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.551133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5842008-d0c8-42ab-9941-0e3cbb01c455 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.569288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.585329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742cdb-4e66-4f7a-a1f2-39eda9214f6e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.608035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.608665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.608948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.609223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.609908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.610215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.612185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.637502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 308/623] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.643926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.663417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.664115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.664399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.664722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.687090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.688588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:49.714713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.715754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:49.716716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:49.716716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:49.716716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:49.723935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 316/624] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.725710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.799883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeae051-6c3a-4635-95b3-ef389f3b4913 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.836678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.837310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.837648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.838225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.845438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.847026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.850581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34537c-4801-4da1-9561-c24d5c497c7a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-3373fe71-5180-4dfd-a211-9e37e2357417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:49.858227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:49.859213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:49.860142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 309/625] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:49.860689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038965-fc44-4f6b-bbfe-8a325e9accc6 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.861799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038965-fc44-4f6b-bbfe-8a325e9accc6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.861799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44038965-fc44-4f6b-bbfe-8a325e9accc6 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.865884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 310/626] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:49.865884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038965-fc44-4f6b-bbfe-8a325e9accc6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.876100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.894374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:49.897883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:49.897883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:49.897883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:49.897883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:49.897883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:49.898251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:49.898330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:49.910917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 317/627] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:49.911762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:49.983764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44038965-fc44-4f6b-bbfe-8a325e9accc6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.020893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8ba0a-0af9-4c98-a79b-57b4d8437e93 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.023220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c823c-53c5-41a0-9e79-1253779086d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.023856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c823c-53c5-41a0-9e79-1253779086d1 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.024139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c823c-53c5-41a0-9e79-1253779086d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.024403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c823c-53c5-41a0-9e79-1253779086d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.036270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c823c-53c5-41a0-9e79-1253779086d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-d11c823c-53c5-41a0-9e79-1253779086d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:50.041218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.051444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 311/628] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.052491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.053374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.053374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.060670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.061288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.061567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.061872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.062624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.062932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.064414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.067779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:50.069057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:50.076111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 318/629] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.077050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.123622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.138361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 312/630] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:50.139216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.168856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.195354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22137-32c1-4deb-bcd6-c03252947290 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.231774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.232467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.232685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.232960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.241375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.242805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.251532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d747d9-3cde-4134-b891-c76fdacb5712 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-27c40652-d586-4127-88d1-ec747d6057a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:50.254306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.255483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:50.256512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 319/631] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.257153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8ca-d8ac-4e3a-b397-915d278047c6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.257153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8ca-d8ac-4e3a-b397-915d278047c6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.257153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8ca-d8ac-4e3a-b397-915d278047c6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.258551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 320/632] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:50.262731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5f8ca-d8ac-4e3a-b397-915d278047c6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.300464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.301464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.301749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.302083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.302755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.303062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.304437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.316990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 313/633] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.316990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.375538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.380329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5f8ca-d8ac-4e3a-b397-915d278047c6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.406573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.416158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.416817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.417095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.417423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/86600b9afdbf43808b4745828a1d3756/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.422945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c76ad0-1879-4db9-94c2-571b087e8efe None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.431803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=86600b9afdbf43808b4745828a1d3756, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.433264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.456564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.457178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.457458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.457729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.458494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.459049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.460479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcee1a-b3e4-46ce-9dd1-ee09876e57ac None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.478347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 314/634] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.479716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.480008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.480284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.497577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:50.498772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:50.506987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 321/635] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:26:50 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/86600b9afdbf43808b4745828a1d3756/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:26:50.508444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.581972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 315/636] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:50.583228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.648553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65b5da-c5fa-4b74-9fb0-58c4fe982ea5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.676648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.701530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.702590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.703201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.703693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.707552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeff2c-d8fe-4c54-9fbe-c68d639b3692 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.716007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.717868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.727327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:50.734476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.742459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:50.743399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:50.743399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:50.743399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:50.743399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 322/637] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.743399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.750188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.751638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.752395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.753143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.770595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:50.777255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:50.784511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 316/638] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:50.786611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.872485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5ec62-f188-425b-bccd-66df18222821 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.897229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48029513-c18d-4515-b35a-acbd0afc41a7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:50.913359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.914002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.914285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.914561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.929784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.935203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:50.935814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:50.936093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:50.936365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:50.937013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:50.937317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.938884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:50.955311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 317/639] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:50.955311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:50.992978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:50.995876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:50.997549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.067445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af7aa9-7235-4a63-a99e-41a24b29725d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.103828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.104547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.104828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.105106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.105800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.106108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.107481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.115192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 323/640] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:51.115940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.120924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 318/641] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.120924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.178010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.228686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bef3d3-ba1f-401a-9954-73108fc5d652 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.229160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.233658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca6591-0364-4475-ac79-05fcccd1d5e8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.264409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.265045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.265327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.265601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.272537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.273524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.273633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.273723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.273946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.275156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.285360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:51.286945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.287884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 319/642] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.294137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:51.294847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.295788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 324/643] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.297586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.400475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a2901-9e2f-48eb-9a6b-abfdec215d60 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.411031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cdaa6-66ae-4e84-915c-f917a630d46a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.415075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.436401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.437036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.437321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.437889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.448743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.449067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.449375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.449654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.449966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.450536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.465788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:51.466392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.467299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:51.468986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:51.468986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:51.468986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:51.469171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.469243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 320/644] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.469243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:51.491300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:51.492367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:51.493696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:51.493696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:51.493696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:51.493696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 325/645] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:51.493696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.511662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.582524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ac2e7-e9a0-4d5f-b733-56180dd2f567 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.605796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bed462-1596-4c40-bdc3-8a2a92a4f080 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.620979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.621744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.622061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.622338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.623075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.623386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.624820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.644369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 321/646] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.644735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.645198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.645948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.646293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.646635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.647411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.647778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.649442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.658187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 326/647] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.658886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.681801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.744176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.758276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700dc808-b7b5-43df-bb3f-691a2e60e617 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.770475 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352ce48-f150-4d73-94ff-f20583451f8b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.794130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.794741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.795017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.795287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.795928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.796228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.797573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.806945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.807565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.807845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.808119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.808764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:51.809069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:51.809980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 322/648] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.810703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.814912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:51.827705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 327/649] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:51.828534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:51.916194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:51.931836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aa711-5a1f-4a2e-9506-14e55c0d2e06 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.952581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c8341-c237-48f3-a043-d4ada0064174 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:51.968659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.969256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.969548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.970413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.989992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:51.990902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:51.991184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:51.991459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:51.993536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.002643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.005937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:52.019664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.020686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:52.021624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:52.021624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.021624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:52.021624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 328/650] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.021888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.047367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.048869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.137038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c0266-584a-46bd-9e8c-cf2292361a67 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.139052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.162849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 323/651] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:52.162849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.179436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.179997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.180280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.180554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.187907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.189390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:52.200828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.201823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:52.202770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 329/652] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.203291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.256493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.280934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e29352-b3d1-4c9c-a13c-abe72e687e17 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.314888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff031b-8065-455d-a63b-3231814a972d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.318294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.318942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.319224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.319498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.327939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.330570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:52.342891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.346465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 324/653] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.347556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.356962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.357577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.357889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.358169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.358820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.359125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.360531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.373845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 330/654] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.375050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.404481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.467090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699cff-5283-4f1d-b3db-11111cfcd554 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.481692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b1a53-ebda-4e97-b47d-41b76d021117 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.490992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.512992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.513633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.513949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.514225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.520730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.521344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.521637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.521958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.522868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.523225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.525541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.527838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.529225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.538173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 331/655] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.538920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:52.543715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.544809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:52.546066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:52.546066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:52.546066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:52.546066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 325/656] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.546066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.639762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.645498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8550580-92cc-4637-b28b-453a65c55fb3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.646308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4775e90d-1e96-4fc8-b88f-acfb98975fa7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.679310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.679839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.679960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.680182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.680457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.680557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.680735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.681008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.681183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.681497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.682991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e97e6-8c04-48fd-a7e8-b0752011bf80 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.689136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.690625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.700729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 332/657] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:52.701674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:52.702674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:26:52.708254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:52.709173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af782de-249a-4faf-ae63-7fad5f04678f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.709173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af782de-249a-4faf-ae63-7fad5f04678f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.709173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af782de-249a-4faf-ae63-7fad5f04678f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.709401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 326/658] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:52.709401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.709567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 333/659] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:52.709567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af782de-249a-4faf-ae63-7fad5f04678f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.733552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.809584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9140b-82f6-45e6-8ba5-36c797469445 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.814968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af782de-249a-4faf-ae63-7fad5f04678f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.843922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.844665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.844950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.845224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.845975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=afdf5eda0a634fe48781ef984f7bf496) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.846286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.847708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.848907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:52.849527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:52.849836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:52.850117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:52.850760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:52.851068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:52.852416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:52.854188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 327/660] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/role_assignments?user.id=afdf5eda0a634fe48781ef984f7bf496&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.855073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.880235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:52.885162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 334/661] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:52.885162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:52.975863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1859c3b8-fdde-47c3-b89d-8cad6a5ffa0b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:52.981715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.002064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1994a02-a5b3-4af9-8fa1-708f51a535a5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.021634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.022440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.022688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.023046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.044981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.045596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.045931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.049239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.049239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.049239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.049239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35522f6a-668a-4f6f-bd1d-e6e04f60cb02 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.070166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 335/662] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.071772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.072060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.072725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.096383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:53.097630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:53.102496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.103963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.127040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.175884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 336/663] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:53.177114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.226722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 328/664] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:53.227830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.265104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.296449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d3f0b-80e0-42b7-97ce-5a8569c7246e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.334229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.334873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.335162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.335646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.343159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.344751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.357545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d20a3-c24f-492c-ba01-96f3244be05c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:53.357915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.359036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:53.360030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 337/665] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.360586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.388131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.409047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.409957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.410406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.410827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.477552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843d77d-e81c-42e4-ab85-0941bb4e28a7 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.489184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.490688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.510931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.524118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.524118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.524118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.524118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.528162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.529592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:53.546841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.548401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:53.549348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:53.549348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:53.549348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:53.549348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 338/666] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.549348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.602740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 329/667] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:53.603907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.626583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.663226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c8453-fae5-498e-880d-91cbf4898b18 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.700545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.701266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.701546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.701967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.702669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.702974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.705174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.708606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a513869-cdb3-44f8-9ae9-f6400e27713f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.723141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 339/668] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.723141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.747378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.748017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.748300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.748573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.758914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:53.763705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.764701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 330/669] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.770903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.776859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.837837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf0e0a-64c1-4751-858c-654bc59d9c16 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.857585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:53.877436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c12c-1544-4b1e-9adf-7fc61e51187d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:53.880196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.880801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.881081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.881356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.882033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:53.882340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.883726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.903268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 340/670] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:53.903268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:53.920111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:53.920756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:53.921125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:53.921464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:53.935709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:53.937170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:53.952800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:53.953822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:53.955386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:53.955386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:53.955386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:53.955386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 331/671] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:53.955614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.011180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500149-fc57-4e70-b1cc-22defd19d49c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.014663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.053787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.054411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.054685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.054953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.055680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=fc5b05e5e96a4afc95ab176576b92577) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.055985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.057472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.064698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 341/672] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/role_assignments?user.id=fc5b05e5e96a4afc95ab176576b92577&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.065295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb52a-35a1-46dd-bdb6-7454168115a0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.076725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.115335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.121992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.126409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.126409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.126409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.126409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.126409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.128584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.139732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 332/673] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.141107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.223577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9621da-49c4-4f7b-b1cc-ed05e581481e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.262088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.262727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.263024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.263266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.263381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a2978-28d0-4136-8146-cb555e48cbd6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.271809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.272828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:54.286912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.287897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:54.288857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:54.290671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 342/674] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:54.291682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.307339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.307883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.308164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.308437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.309090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.309395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.310810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.324304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 333/675] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.325152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.337619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.398954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.439154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa98b1-e889-4712-af80-20d552f12420 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.450202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc03ab-41d2-4fc0-bc33-e544c827cdb3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.487361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.497651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.497651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.497651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.501757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.502298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.502676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.503051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.503873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.504285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.505833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.512487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.514715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.520889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 334/676] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.522025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:54.533030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.534257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:54.535395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:54.535395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:54.535395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:54.537052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 343/677] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:54.542812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.631638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.653015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2aacc4-dee1-49ce-92ca-10d33f630dbc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.659814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942657b7-6c47-4ce7-a0fb-e8ebdc54e57b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.675509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:54.701937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab48465-8655-4259-b902-b778db337727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.702983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab48465-8655-4259-b902-b778db337727 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.703541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab48465-8655-4259-b902-b778db337727 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.704695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab48465-8655-4259-b902-b778db337727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.705353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.706098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.706478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.706856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.707910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=21235d5078fc408da2d9f4e35ab51a79) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.708898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.710670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.714059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab48465-8655-4259-b902-b778db337727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.716624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab48465-8655-4259-b902-b778db337727 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.718908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 344/678] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/role_assignments?user.id=21235d5078fc408da2d9f4e35ab51a79&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.720312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4ab48465-8655-4259-b902-b778db337727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:54.731291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:54.732400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:54.733543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 335/679] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:54.743296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab48465-8655-4259-b902-b778db337727 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.881417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04c74-4839-4288-a90a-319fbc6f4354 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.937970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:54.939255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.939642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.940535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.941467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:54.941977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:54.944467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a16982-2b4c-4b16-95d8-90fe87fcb724 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:54.952388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab48465-8655-4259-b902-b778db337727 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:54.960921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 345/680] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:54.962471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e93d-0278-4d8f-8724-45a2e005f31f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:54.962895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e93d-0278-4d8f-8724-45a2e005f31f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:54.963855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86e93d-0278-4d8f-8724-45a2e005f31f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:54.966632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 346/681] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:54.967841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86e93d-0278-4d8f-8724-45a2e005f31f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:54.985528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.002528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.004459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.004459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.004459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.004775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.004884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.006578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad47a47-6e4f-4b38-9a71-2aeabf3c63e5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.019229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 336/682] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.024538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.024538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.024538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.045882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:55.048547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:55.087587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.095097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86e93d-0278-4d8f-8724-45a2e005f31f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.132379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.133458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.133942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.134377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.143844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.145294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.147496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 337/683] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:55.149977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:55.172350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:55.174133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:26:55.175157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:55.179775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 347/684] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:55.184160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.279399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.347200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4868f-e01a-45fe-907c-745aef3a1f89 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.348850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb096b-40d9-46e5-b2a3-7e8de0622562 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.413477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.414377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.415188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.415935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.416358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.416771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.417194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.418110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=db35ea7cc80d49caa8187dcde2d55642) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.418528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.419389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.419837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.421413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.421922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.424025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.436891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 338/685] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/role_assignments?user.id=db35ea7cc80d49caa8187dcde2d55642&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.456542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 348/686] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.462702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.505404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.534335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.636304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b63b87-b4a5-43a5-9436-86da80f7832d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.662467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79526-5153-483b-9192-703fdfea08f2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.695867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.702253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.703120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.703499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.704394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.709168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.710049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.710472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.710889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.717739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:26:55.725551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:55.726776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:26:55.727843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:55.734148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 349/687] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:55.736161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.792576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.794460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.824562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:55.858530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ace71-8d64-42e8-ba6d-4b8aece21cd1 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:55.910548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:55.911376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:55.911766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:55.912138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:55.912922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:55.913329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:55.915665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:55.919684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 339/688] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:55.926975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:55.932797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 350/689] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:55.939861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.005622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.055327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eeb7f7-c7ef-44a7-9511-afe847e66a16 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.070212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc910b0d-b790-427a-9748-151554eff283 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.105182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.133779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.134940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.136266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.136912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.156541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.157510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.157959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.158832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.163227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.164705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.182599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.184417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:56.198471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.199498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:56.200421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:56.200421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:56.200421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:56.204579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 340/690] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:56.211304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:56.223215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.224296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:56.225209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:56.225209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:56.225209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:56.227471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 351/691] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:56.233479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.375193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.384758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df09cd6-f2e0-4918-9692-c6192403aca4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.407457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21060ffd-5f98-44b3-9acd-c512f51121f3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.433777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.434654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.434938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.435642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.436580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.436892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.439016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f14fd-449c-4816-90e0-4c3c5cc982f5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.443344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.444034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.444403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.444794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.445518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.445936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.447362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a581af-8dbc-4a8d-912d-d6a25d3add8e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.452265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 352/692] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:56.454465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe879ceb-12c0-4f8e-8975-ca3f93969d55 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.454909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe879ceb-12c0-4f8e-8975-ca3f93969d55 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.455190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe879ceb-12c0-4f8e-8975-ca3f93969d55 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.456699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 353/693] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:56.458448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe879ceb-12c0-4f8e-8975-ca3f93969d55 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.477476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 341/694] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:56.479113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.479549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.479968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.499210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:56.500668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:56.539362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.580170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 342/695] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:56.581320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.589800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe879ceb-12c0-4f8e-8975-ca3f93969d55 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.628955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.629522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.629831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.630116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.640573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.642834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:26:56.661816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.663042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:56.664041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 354/696] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:26:56.664640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.702568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.761788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270016d-d053-4b45-af25-bdf157dd426e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.801519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.802197 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.802539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.803259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.810735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.812831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:56.826064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:56.827173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:56.828267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 343/697] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:56.834922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.898205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:56.916948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fcf700-c0fa-4568-b168-ebf55d8580b5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:56.953019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:56.954576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:56.954701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:56.954960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:56.955697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:56.956042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:56.957461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:56.976429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 355/698] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:56.977282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:56.986702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd0ce-cb97-440c-8c8e-a5923373b35e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.028666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.029303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.029585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.029892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.030611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.030918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.032562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a8553-7e4b-48c0-8a8e-363c027e2291 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.050366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 344/699] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.050366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a53f-915a-4981-816a-b1039490ffc2 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.050366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a53f-915a-4981-816a-b1039490ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.050366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889a53f-915a-4981-816a-b1039490ffc2 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.050366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 345/700] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:57.050366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a53f-915a-4981-816a-b1039490ffc2 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.061845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.089123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df6416-c4d7-40c3-8702-fbcbbf4f832a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.123825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.124459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.124736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.125007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.137427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.138913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.149053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:57.156227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:57.164599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:57.165730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:57.165730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:57.165730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:57.165730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 356/701] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:57.165730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.166124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889a53f-915a-4981-816a-b1039490ffc2 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.203063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.203679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.203959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.204231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.270568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80527d9f-ece6-464e-9518-2838fc2f4032 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.274683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.276140 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.298623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.308247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.308851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.309128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.312237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.312237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=86600b9afdbf43808b4745828a1d3756) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.312237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.312237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3ad9b-4fb8-4f97-9765-b6065fdabc3f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.328045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 357/702] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/role_assignments?user.id=86600b9afdbf43808b4745828a1d3756&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.328045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.328045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.328045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.346053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:57.347405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:57.389028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.402662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 346/703] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:26:57.406577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.439827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 358/704] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:57.440879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.542531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dc376-b969-461f-9a4e-e207a23c9789 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.591136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.591744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.592175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.592442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.593380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.593677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.596875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.612672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4dc1f-f2e6-4665-b8fe-56054186bce0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.613166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 347/705] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.622942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.635869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.649811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.650454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.650749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.651068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.662123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.663490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:26:57.679683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:57.680702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:26:57.681640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:26:57.681640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:26:57.681640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:57.681889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.681964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 359/706] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:57.690023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.742046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f8a96-f20d-4cc0-a601-e38be0c0c81d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.782562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.783192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.783471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.783739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.784388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.785868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.801129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97961ae-07c7-42e5-9d28-9454e04373b2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:57.838147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:57.838817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:57.839094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:57.839410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:57.840059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:57.840354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:57.841913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:57.857854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 360/707] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:57.859145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.878271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 348/708] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:26:57 2022] POST /identity/v3/users => generated 254 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:26:57.879259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:57.899139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:57.998609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e62808-5904-4608-a682-5f259c34ca6e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.071098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b54f39-b0e9-48af-b03e-c2d947a44afe None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.076742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.077076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.077411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.077687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] PATH_INFO: `/v3/services/network` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.079271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.080541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.081240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-fd1bef0b-3774-49ca-8aa4-dc3ab8bc353e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.094384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:58.100331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 361/709] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.101141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479674e1-27a8-47e4-b849-a624b73b1a9d None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.101141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479674e1-27a8-47e4-b849-a624b73b1a9d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.101141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479674e1-27a8-47e4-b849-a624b73b1a9d None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.102972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 362/710] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:58.108311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.108879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.109368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.126789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.127672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.128706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.129107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.135751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:58.137493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.137738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:58.139256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:26:58.156426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.157645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:26:58.158719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:26:58.160192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 349/711] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.160802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.263805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 363/712] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:26:58.264423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.321472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.459246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0e8b-2c8b-4794-8a1c-ecdc04cfeffa None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.499833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04415d3-8d52-4b49-962d-8405b59b54e7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.541047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.541664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.541991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.542263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.542962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.543267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.545033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.558151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 364/713] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:58.564990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.583637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.584250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.584532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.584805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.585439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] RBAC: Adding query filter params (name=network) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.585744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.587141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.598805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 350/714] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:58.604269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.645017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.682522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:58.700502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01a1ef-e6e0-4b76-99fa-491f83dd9661 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.729171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee968-d1ea-4bb7-bcdc-3983518a6e2d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.738643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.739258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.739921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.739921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.740637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=afdf5eda0a634fe48781ef984f7bf496) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.740952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.742535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.748946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 365/715] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/role_assignments?user.id=afdf5eda0a634fe48781ef984f7bf496&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:26:58.749848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:58.805441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.806034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.806316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.806593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.807250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] RBAC: Adding query filter params (type=network) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:58.807556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.808956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.826902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 351/716] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:58.919661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f05691-b125-47e8-9773-d754dd50c559 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:58.969523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:58.970209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:58.970493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:58.970769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:58.971366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:58.972733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:26:58.986279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:26:58.987355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:26:58.988213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 366/717] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:26:58.994923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.133109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.140149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e0945-2ec7-439d-a48c-0b7116d65e80 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.179374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.179989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.180267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.180537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.181173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.181475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.182872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61727e9-6c47-4438-a725-fa160b606f31 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.189059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 352/718] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 24 03:26:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.194881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:26:59.217288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:26:59.317460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891c36a-45f8-413c-b81c-b095def3d68c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:26:59.362066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:26:59.362691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.362970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.363246 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.363888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:26:59.364191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:26:59.365587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00938bfa-85de-4f88-954c-7f3145ce232b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:26:59.375020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 367/719] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 24 03:26:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:26:59.766750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921939e-041d-46f0-a5c0-eace599a2a6b None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.767436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921939e-041d-46f0-a5c0-eace599a2a6b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.767436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921939e-041d-46f0-a5c0-eace599a2a6b None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.768783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 353/720] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:26:59.774559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be63e-5154-4711-acbf-2f3d534be52c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:26:59.775095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be63e-5154-4711-acbf-2f3d534be52c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:26:59.775095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0be63e-5154-4711-acbf-2f3d534be52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:26:59.796529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9b0be63e-5154-4711-acbf-2f3d534be52c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:26:59.798444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9b0be63e-5154-4711-acbf-2f3d534be52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:26:59.889851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 368/721] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 03:27:00.166950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87358-22db-4f35-a0a3-4b542e1270b7 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.167364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87358-22db-4f35-a0a3-4b542e1270b7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.167537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87358-22db-4f35-a0a3-4b542e1270b7 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.169109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 354/722] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:00.174349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.174640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.174919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.196807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:00.198037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:00.200102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.269787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 369/723] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:00.320741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87358-22db-4f35-a0a3-4b542e1270b7 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.448374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87358-22db-4f35-a0a3-4b542e1270b7 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.498340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.498970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.499247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.499514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.510081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:00.515329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:00.517003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:00.518047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 355/724] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:00.526893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.659740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.671280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa41e35-cba5-441c-b6ce-b86cbe99cbd0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.680564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.706871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.707524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.708045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.708326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.708992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:00.709296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.710730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.715896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:00.720185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 370/725] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:00.725648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.800167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c7d0-780f-42bd-8784-be1837fc4c5f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.877053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.877703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.878007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.878279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.885134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42fa95-3972-4c57-8457-2699831dd785 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:00.905526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:00.910918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:00.912139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:00.913222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:00.919884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 356/726] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:00.920754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:00.943065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:00.943963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.944245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.945000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.959850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:00.961913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-24a93c64-f6ab-453a-a7ce-e08fa4ed065f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:00.980671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:00.982876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 371/727] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ba8e8-8a5f-4723-9ff2-f3cc12d25359 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ba8e8-8a5f-4723-9ff2-f3cc12d25359 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:00.985310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ba8e8-8a5f-4723-9ff2-f3cc12d25359 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:00.990408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 372/728] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:00.990788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ba8e8-8a5f-4723-9ff2-f3cc12d25359 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.028124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.054161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82d781b-3263-4834-bcb7-80779c0a7931 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.055200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.100567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36642977-3754-40f3-b39f-8501786014cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.101373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36642977-3754-40f3-b39f-8501786014cb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.101747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36642977-3754-40f3-b39f-8501786014cb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.102145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36642977-3754-40f3-b39f-8501786014cb None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.102917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36642977-3754-40f3-b39f-8501786014cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.103327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36642977-3754-40f3-b39f-8501786014cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.104928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36642977-3754-40f3-b39f-8501786014cb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.114875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 357/729] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.116284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ba8e8-8a5f-4723-9ff2-f3cc12d25359 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.116483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.116885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.117262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.136911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:01.138323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:01.183245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.184021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.184364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.184758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.185498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.185946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.187448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.201319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 373/730] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:01.202442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.216606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 358/731] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:01.217511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.348617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.382924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb75c7-cfe2-4ca6-83fe-b97345a6a7df None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.405660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.409472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23ec80-07a3-439e-9dea-0d8236330a81 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.449874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.450519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.450799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.451072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.470184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.474847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.481221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.481908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.482190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.482588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.507068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.507068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:01.507577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.509480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:01.510930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:01.510930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:01.510930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:01.510930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 374/732] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.516959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4dd1d9f8-1999-42a8-a123-4b34df11202d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:01.528477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.530426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 359/733] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eecce-5769-4bc3-a6f3-cd661678137a None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.532157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eecce-5769-4bc3-a6f3-cd661678137a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.533065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1eecce-5769-4bc3-a6f3-cd661678137a None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.533065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 360/734] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:01.538070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eecce-5769-4bc3-a6f3-cd661678137a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.638998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea668940-0c21-44f9-ab26-67cb40430ac8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.660336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1eecce-5769-4bc3-a6f3-cd661678137a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.678066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.678757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.678958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.679240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.680005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.680261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.681592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456a88-fce2-4d06-9f8a-ed64334697e6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.691875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.699181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 375/735] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.699181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.699181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.699181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.708058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.708058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.708058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.708058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.708443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:01.708443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:01.708443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:01.716310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:01.717587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:01.730149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 361/736] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:01.730149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.744469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:01.808957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 376/737] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:01.809864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.840330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d4793-e3de-4f14-938f-5a679cc5ad17 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.891566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:01.892579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:01.893099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:01.894111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:01.911083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:01.918681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:01.919699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:01.920573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:01.928375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 362/738] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:01.928375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:01.959785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507afe3-c3cf-4a79-be4c-ef88c85fea5c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:01.993655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.004985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.006137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.007398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.007398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.018625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.021201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:02.035554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.036776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:02.038028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:02.043716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 377/739] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.043716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.057093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.059877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2ae0e-18fc-435d-af84-4c3816c98278 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.101808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.102482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.102762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.103092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.143967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbc45-3b44-4ea1-a5af-a76737ec5556 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.171161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.172667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.177382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.178028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.178308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.178655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.179323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:02.179625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.180980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6681a2-b171-424d-afd7-06c0d37b2564 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.189542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 378/740] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:02.190771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b7d7-9388-449c-86f7-344ac87a35c0 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.191048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b7d7-9388-449c-86f7-344ac87a35c0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.191328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b7d7-9388-449c-86f7-344ac87a35c0 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.196545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 379/741] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:02.197327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b7d7-9388-449c-86f7-344ac87a35c0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.230109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.290953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 363/742] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:02.291802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.304313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.329278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4b7d7-9388-449c-86f7-344ac87a35c0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.363488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.364099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.364376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.364644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.365368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:02.365711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.367160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.386668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 380/743] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:02.388831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.399423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64ca8e-065f-425f-b22a-229def98a2d8 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.433247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04318bc-dbea-4863-9c01-cc16d57e2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.433874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04318bc-dbea-4863-9c01-cc16d57e2e3b None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.434153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04318bc-dbea-4863-9c01-cc16d57e2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.434422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04318bc-dbea-4863-9c01-cc16d57e2e3b None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.435058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04318bc-dbea-4863-9c01-cc16d57e2e3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.436475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04318bc-dbea-4863-9c01-cc16d57e2e3b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.490964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905f267-4ae5-4a8a-a80c-823da4e1cdaf None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.525258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.525912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.526190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.526459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.528445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.534640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 364/744] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:02 2022] POST /identity/v3/services => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:02.535999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.536300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.536569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.538699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.540166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:02.557531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.558762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:02.559672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:02.559672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.559672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:02.559672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 381/745] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.559672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.561125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:02.562555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:02.569482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.668272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 365/746] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:02 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 03:27:02.669935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.693406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6d51e-ae88-423d-8e56-b16c65d211bf None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.741192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.742577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.742577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.742577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.756006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.757499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:02.780782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:02.782037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:02.782998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:02.782998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:02.782998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:02.783595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 382/747] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:02.785093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.828901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841021e-2811-4349-90d5-459121c3fd36 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.837205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.873064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.874600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.875821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.876095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.879666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:02.903376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de286-7bc7-447b-b540-55a732acd672 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:02.947240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:02.947857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:02.948139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:02.948413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:02.949066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:02.949373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.950799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:02.963337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 383/748] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:02.966601 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:02.973887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:02.975352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.077923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.082346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f970af7-a300-4df9-b198-7e936db92680 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.083658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 366/749] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 03:27:03.084341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.119693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.122864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.123486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.123767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.124043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.124692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.125538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.127224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.145059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 384/750] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.145059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.199904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94385064-8f29-4157-97d1-71856cf9586b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.236402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.237015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.237296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.237571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.238246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.239620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.249757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781bb7d-84ba-45f8-9823-6450911216b4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.283757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.284389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.284672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.284947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.292302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.293743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.309979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 367/751] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:03 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:03.310205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.311154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:03.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:03.313535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.313625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 385/752] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:03.313625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.340626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.433483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.447406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bc66e-1a79-4563-ac6b-b49c2d8bb2e5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.464175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4013b-b7b0-48d6-9ee5-e8d9b5ce4509 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.499917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.500577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.500858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.501128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.506493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.507130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.507410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.507683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.514950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.516692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.516948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.518403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:03.530083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.531026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:03.532578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 386/753] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:03.533085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:03.544153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.545154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:03.546088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:03.546088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:03.546088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:03.546088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 368/754] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:03.549788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.625945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.655700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac77b0-8705-40bb-a45b-029b4c13af4a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.688950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abae2bd-974c-4975-8d2a-e4e42590ffdb None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.694589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.695310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.695590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.695865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.696624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.696931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.698472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.723460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 387/755] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.724884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.742571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.743192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.743473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.743747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.744551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.744861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.746404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.760679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 369/756] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.766707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.769635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.838189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec21a0-cd89-4c41-a34f-ef7d4b46ea76 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.880023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.881056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.881510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.881684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce3b5b-63ba-4304-a640-eb62b937fdb0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:03.882489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.883596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:03.884982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.886561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.890202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:03.902688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 388/757] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:03.904514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:03.926101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:03.927909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:03.928750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:03.929213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:03.944442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:03.947389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:03.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:03.968694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:03.969601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:03.969601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:03.969601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:03.976069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 370/758] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:03.976069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.036479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0bb4-a097-4379-ae69-b6ce47a4226a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.037984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.081643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.082920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.083844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.084319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.085536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=86600b9afdbf43808b4745828a1d3756) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.086235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.088480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.096120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c506-d145-42d1-9501-364573d83204 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.101889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 389/759] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/role_assignments?user.id=86600b9afdbf43808b4745828a1d3756&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.103470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.237006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.238083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.239786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.239786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.239786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.259471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.261806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:04.280175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:04.281729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:04.283346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 371/760] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:04.287674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.300456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9eb45-4ec7-4009-9c55-e1a2d434c168 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.340255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.341364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.341893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.342362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.343358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.344394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.346092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.364289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 390/761] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.367051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.408105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc2f33-1afb-4cbb-bde9-9d1b85301d00 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.425050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.448010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.448625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.448904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.449174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.453198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.453198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.453198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.466510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 372/762] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:04.473975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.588837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3050ced-75de-4f84-bd0b-7769ce27106c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.628441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafacbe-173d-4331-836a-43bbc19d899a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.630201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.631632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.631919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.632196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.632920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=f5c5765e56b848d4a8091de1570bfbc5) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.633234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.634688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d472934-3f2c-4b3f-8f08-2dfed05f872a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.642613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 373/763] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/role_assignments?user.id=f5c5765e56b848d4a8091de1570bfbc5&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.643970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8763-7289-4789-b498-28e3691fecef None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.644259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8763-7289-4789-b498-28e3691fecef None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.644532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8763-7289-4789-b498-28e3691fecef None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.646040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 374/764] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:04.658915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.667582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.667892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.668132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.694578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.695238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.695526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.695797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.697261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:04.698550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:04.709607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.711117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:04.740535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:04.741517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:04.742488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:04.745047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:04.751519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 391/765] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:04.753031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:04.831763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 375/766] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:04.905994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c940d-e681-46e0-bdcd-d1da4e6af5cf None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:04.951483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:04.952262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:04.952549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:04.952899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:04.953605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:04.953984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:04.955425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:04.972947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 392/767] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:04.978884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.118856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff14e-087a-4e84-a944-06ab291627d4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.166955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.183036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.184050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.184529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.184994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/afdf5eda0a634fe48781ef984f7bf496/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.187233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=afdf5eda0a634fe48781ef984f7bf496, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.189069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.225913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.269941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 376/768] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:04 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/afdf5eda0a634fe48781ef984f7bf496/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:27:05.291438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b92cb4-fcc6-426c-885d-9b55e9c3889f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.331036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.331729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.332010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.332287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] PATH_INFO: `/v3/services/network` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.333134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.334630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-abdd4b8b-8cdc-445e-b853-83dffc406583 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:05.344582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:05.345622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:05.347130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 393/769] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:05.355256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.414088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.423422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0f60-6090-4eae-97bd-811d86e05a70 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.423596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0f60-6090-4eae-97bd-811d86e05a70 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.423872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0f60-6090-4eae-97bd-811d86e05a70 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.425207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 394/770] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:05.431838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.432167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.432378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.467794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:05.477066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:05.541994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f4dfa-669d-4c63-86cf-cf0aad6bd19a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.579892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 395/771] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:05.604387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.605013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.605291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.605560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.606238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] RBAC: Adding query filter params (name=network) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.606541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.607913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.613431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 377/772] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.619025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.664387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.748844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0157-de37-4bc3-9e6d-68b4f40ff530 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:05.798098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:05.798721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:05.799004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:05.799278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:05.799922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] RBAC: Adding query filter params (type=network) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:05.800225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:05.801603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:05.810126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 396/773] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:05.816480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.940116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:05.971357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:05.988072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3e8aa-3273-469b-905e-0d2c555da60e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.050843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.051470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.051755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.052251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.052970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] RBAC: Adding query filter params (interface=public, service_id=90b7540cab0b49db8dfd41dc4462bedf, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.053378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.054884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.075993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 378/774] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/endpoints?service_id=90b7540cab0b49db8dfd41dc4462bedf&interface=public®ion_id=RegionOne => generated 194 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.081361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.155737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.163997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae37fb-a236-47bb-8276-0f3546f51bac None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.190605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e4622-9c4a-4d30-86ed-5e65b39c1949 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.226425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.227048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.227332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.227627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.228226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.229599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.235979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 379/775] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/services => generated 772 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.253633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.254327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.254612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.254883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.255497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.256950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:06.273229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:06.274574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:06.275853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 397/776] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:06.281325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.316111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.440970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d5c4-d153-4aae-8d1c-71e5b2d19624 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.494779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.495395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.495677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.495949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.496583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.496887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.498295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.503924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 380/777] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.509617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.617361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9f63d-09b2-4961-9617-9edae2bc7f67 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.652550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.653221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.653507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.653791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.654491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.654796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.656718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89a33f-3cc4-4d0e-b48a-72682610b5d4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.662233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 398/778] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:06.668036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.670986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd053e0d-7807-49e5-b241-fd7bbd3d4432 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.671533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd053e0d-7807-49e5-b241-fd7bbd3d4432 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.672512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd053e0d-7807-49e5-b241-fd7bbd3d4432 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.674366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 399/779] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:06.684366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1658-7cbf-4790-9b9a-3b741713c6d5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.684645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1658-7cbf-4790-9b9a-3b741713c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.684985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f1658-7cbf-4790-9b9a-3b741713c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.791037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:06.809315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c528c2-a5fc-4bf9-b863-da907743e57e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:06.863566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:06.864214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:06.864498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:06.864777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:06.865510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] RBAC: Adding query filter params (interface=public, service_id=9c8154f1601d48039587af016abdefc3, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:06.865846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:06.867304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:06.885450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 381/780] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/endpoints?service_id=9c8154f1601d48039587af016abdefc3&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:06.891167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:06.903468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2f7f1658-7cbf-4790-9b9a-3b741713c6d5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:06.904763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2f7f1658-7cbf-4790-9b9a-3b741713c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:06.943834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.013047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 400/781] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:07.015692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e834a-3591-4571-be8d-c3b8c9c537a8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.015987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e834a-3591-4571-be8d-c3b8c9c537a8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.016266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e834a-3591-4571-be8d-c3b8c9c537a8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.018271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 401/782] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:07.031964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.032277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.032510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.033873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67855fdf-a3c1-4dd5-a57e-8efafe49d43d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.052913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:07.054188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:07.077013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.078161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.078459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.078730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.079335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.080697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.094269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 382/783] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:06 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.153001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 402/784] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:07.352223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.371425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.496727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c9f91-9349-4e1c-bfbb-6b85ba3e529f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.514344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.553039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.554124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.554614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.555089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.576733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:07.583681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.584636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:07.585514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:07.595026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 383/785] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:07.601274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.665193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.684981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37575109-eac5-4503-9dcc-3aaa085b688d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.697731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:07.739494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cd408-b1a5-419e-ae32-322ddac05c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.740488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd408-b1a5-419e-ae32-322ddac05c67 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.741839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd408-b1a5-419e-ae32-322ddac05c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.742329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cd408-b1a5-419e-ae32-322ddac05c67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.745900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c60f-911b-4b46-ae80-435b386a718f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.759842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cd408-b1a5-419e-ae32-322ddac05c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-056cd408-b1a5-419e-ae32-322ddac05c67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:07.767080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:07.768138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:07.769012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:07.773918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 403/786] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:07.776681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa3e87-ce0e-41e2-9083-854b0d9e4159 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.776986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa3e87-ce0e-41e2-9083-854b0d9e4159 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.777236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa3e87-ce0e-41e2-9083-854b0d9e4159 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.779603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 404/787] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:07.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa3e87-ce0e-41e2-9083-854b0d9e4159 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.804675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.805299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.806079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.806355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.807378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.807691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.809241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba900edb-0bf5-4b1a-b35d-001cfb75988e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.821615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 384/788] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.823022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.823305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.823583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.843290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:07.845024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:07.902613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa3e87-ce0e-41e2-9083-854b0d9e4159 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:07.917170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 385/789] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:07.918188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.959320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:07.959999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:07.960281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:07.960554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:07.961282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:07.961591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:07.963075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:07.978070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 405/790] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:07.983767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:07.988118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.005744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.038291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999866b2-3b42-4ca0-922b-c24e29c21375 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.079055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.079055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.079055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.079055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.089231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.090861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:08.106848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.107882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:08.108806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:08.108806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.108806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:08.108806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 386/791] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.118804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.180001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75f59d-f5bc-4a92-89ed-b9556fc7784f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.235931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95815c39-2aac-485c-8f83-f41cf4f1ecf2 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.253704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.262567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.263155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.263434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.263707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.273397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.274039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.274317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.274588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.275229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.275530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.276904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.285125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.286671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.293954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 387/792] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.295769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:08.315962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.316968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:08.317917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:08.317917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:08.317917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:08.324433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 406/793] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:08.325659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.414142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.432848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334826c-dd8e-4aaa-a251-c7a3bd6af653 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.476891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e5c8-5dbb-41b2-96ef-06a7c513d2a7 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.479270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.480891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.481183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.481456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.490916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.493076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:08.510142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.511161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:08.512116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:08.516253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 388/794] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:08.517167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.524387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.525645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.526127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.526598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.540346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:08.546914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.547901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:08.548775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:08.551369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 407/795] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.556444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.559170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.637400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786815e-5d6a-4e58-82fc-c7c52206ecc4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.675656 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.676693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.677324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.677916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.678760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.679275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.680493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03697b-19a1-473a-b545-4dc0f798180b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.681164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.701216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 389/796] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.702715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.705669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.722895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.723504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.723805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.724214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.724955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.725269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.727465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.755445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 408/797] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.755445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.832472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:08.839123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2675-a208-4c55-b9e2-7cb185e7303f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.878715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce1662-13d0-4d81-aa94-fdd3fe67e614 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:08.879599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.880344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.880494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.880761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.881427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:08.881730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.883134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.896360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 390/798] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:08.896360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:08.923542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:08.924295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.924576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.924849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.932310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:08.933742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-cadc4e06-ca82-440c-81d3-dcc278d9383d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:08.945492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:08.946534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:08.947542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 409/799] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:08.948152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ff42-0915-4fef-9a8e-82dd024e2e9b None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:08.948152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ff42-0915-4fef-9a8e-82dd024e2e9b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:08.948288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492ff42-0915-4fef-9a8e-82dd024e2e9b None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:08.949640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 410/800] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:08.954263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492ff42-0915-4fef-9a8e-82dd024e2e9b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.000356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.007805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4297-c778-4808-8e52-eca533dd408c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.050122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.050807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.051029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.051298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.063130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.064577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.069613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492ff42-0915-4fef-9a8e-82dd024e2e9b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:09.079166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.080235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:09.081176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:09.081176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.081176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:09.081176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 391/801] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.081447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.095723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.112381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.113155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.113537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.113955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.125437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.127167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-cd308bd2-d891-4d05-ae5d-f42eff64c571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:09.144508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.145688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:09.146950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:09.146950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.146950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:09.146950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 411/802] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.149991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094bfde-06ca-4020-9eca-98272273918d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.150747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094bfde-06ca-4020-9eca-98272273918d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.151027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094bfde-06ca-4020-9eca-98272273918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.170692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3094bfde-06ca-4020-9eca-98272273918d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:09.171937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3094bfde-06ca-4020-9eca-98272273918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:09.191472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688e751-3fc0-43ec-85e7-82e19787c78b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.229901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.230519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.230789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.231057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.231793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.232096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.233546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.245834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 412/803] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:09.245834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094bfde-06ca-4020-9eca-98272273918d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.256130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 392/804] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.261578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.278867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.375431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094bfde-06ca-4020-9eca-98272273918d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.414711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.415580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.416010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.416471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.417267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.417714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.419258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.436031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 413/805] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.436031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.462106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.501543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29fcda-e00d-4468-8a29-2d8de3c606cf None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.521253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.536266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.536875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.537152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.537421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.538136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:09.538399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.539768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfbfac-0309-4a94-83fd-75f6932cde23 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.540795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d05af-3063-47d2-8e2c-1b691fde6683 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.551923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 393/806] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:09.553161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9f8dd-68e5-4c90-8bb4-4fe1feec05ed None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.553487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9f8dd-68e5-4c90-8bb4-4fe1feec05ed None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.554067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9f8dd-68e5-4c90-8bb4-4fe1feec05ed None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.555508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 394/807] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:09.556105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9f8dd-68e5-4c90-8bb4-4fe1feec05ed None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.578885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.579546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.579797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.580067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.591116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.592555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:09.610577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.611804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:09.612961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:09.612961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:09.612961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:09.612961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 414/808] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.612961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.671010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9f8dd-68e5-4c90-8bb4-4fe1feec05ed None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.697930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.706365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.706999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.707595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.707886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.714551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.715987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:09.727292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.728298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 395/809] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.734323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.734887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b17a8d-8ae6-4777-8c1b-b93ef1dfb494 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.760978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:09.766739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.767367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.767645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.767915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.768491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.769885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-f233a1b7-935f-4412-aa01-5ec38d952fd7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.778390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.779549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:09.780408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 415/810] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.781369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.781713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.782453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.799614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:09.800822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:09.837417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf7015-0e21-4796-8912-af549ca9b718 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:09.870082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 416/811] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:09.870955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:09.871084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.871766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:09.872122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:09.872467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:09.880653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:09.882109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:09.894295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:09.895268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:09.896236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 396/812] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:09.896842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:09.951755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.002157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c4e4-6c04-48ac-a4a3-025ab252ea87 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.012184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cee878-4dc7-47cf-a0f2-db903e74892f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.039750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.047981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.048590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.048874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.055233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.055785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.055893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.055979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.056064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.056164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.056164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.056164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.056164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.056447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.056549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.065485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 397/813] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.066365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.066776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 417/814] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.067766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.178387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d25731-c27e-4818-91d8-6c28992e9563 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.182792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade32a9-14a2-4381-ab44-27c67f8a7cd5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.188073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.213542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.214099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.214465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.214736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.215353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] RBAC: Adding query filter params (name=network) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.215646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.216996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.217256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.217894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.218234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.219025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.219753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.220058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.221461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.222123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 398/815] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.222811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.238977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 418/816] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.239824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.285551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.329835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37a385-6969-4e4a-823c-2a7f765dd5db None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.344778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26833a33-c086-47aa-8418-4115a3015c35 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.363503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.364229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.364509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.364781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/86600b9afdbf43808b4745828a1d3756/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.366816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=86600b9afdbf43808b4745828a1d3756, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.368239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.379837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.387122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.387122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.387122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.387858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.389294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:10.401012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.402074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 419/817] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:10.403177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.459354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 399/818] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:10 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/86600b9afdbf43808b4745828a1d3756/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:10.460185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.510611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.531516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82135cc7-33b4-47ca-8b28-ce5090409a18 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.535152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.571114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.571780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.572037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.572317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.572924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.574392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:10.584904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:10.586145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 03:27:10.587211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:10.591384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 420/819] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:10.592378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.599853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41af1a-b206-43c3-9d4a-a9e1f07e67ea None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.639886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.641022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.641304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.641574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.642241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] RBAC: Adding query filter params (type=network) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.642546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.644414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.649877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 400/820] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.650687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.713945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1957f-819a-4275-a85c-a2bd9212bd5e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.751609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.752142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.752422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.752702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.756979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.762994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afaf6c4-ba6f-44ac-9e13-f0d551b4de90 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.788347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:10.806131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.806819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.807462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.807462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.808051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.808472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.809919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.828791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 401/821] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.828791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.830474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.832269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.934899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dd84b-a6c7-4ac4-8745-304b84c16aae None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:10.942917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 421/822] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:10.944451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:10.971773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:10.972497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:10.972780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:10.973069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:10.973685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:10.974022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:10.975387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:10.984999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 402/823] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:10.985867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.010466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.024118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.066250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d0d27-4a0c-4827-b100-4ec1fd9863c2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.096685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b9715-0699-4f4e-aed2-37e0f5737851 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.105612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.106273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.106552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.106828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.107490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.108890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.132721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.133385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.133682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.133978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/f5c5765e56b848d4a8091de1570bfbc5/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.149905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=f5c5765e56b848d4a8091de1570bfbc5, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.151333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.202231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 422/824] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:11.203630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.237146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 403/825] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:10 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/f5c5765e56b848d4a8091de1570bfbc5/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:11.237146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.380231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.417228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dc244-0b77-404a-b239-3294abe388b0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.417927 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361d6c8-98ac-43a8-8422-4c1e5aa88660 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.458194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.471847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.471847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.471847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.471847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.472275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.472275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.472653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.472787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.473304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.473584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.474382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.484826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 404/826] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.486972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.488456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.490103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:11.510397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.511633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:11.512771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:11.512771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:11.512771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:11.514886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 423/827] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:11.522781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.632039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8f9d-c988-4d49-b8d4-c159c3015c65 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.641560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9aaa1-9d87-4a9b-8c16-fef6b29e4874 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.677988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.678605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.678889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.679164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.679837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.681363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.681853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.682721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.683262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.683753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.684741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:11.685416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.687229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.688090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.703410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 424/828] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:11.709115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:11.744796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:11.759856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 405/829] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:11.835158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9187da7-9d19-4d49-ae28-a7e5d38c587c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:11.883872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:11.884445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:11.885005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:11.885340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:11.893631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:11.895135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:11.908111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:11.909084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:11.910131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 425/830] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:11.916822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.030230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903c10b-89dc-483f-b403-549fc78c5757 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.070309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.071287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.071800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.072276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.073200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.073709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.075372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784929-b804-47d1-9099-f825656373f6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.089045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 406/831] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.096163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.199567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.212667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ee538-c520-4352-a54f-68fa560f2ca0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.248528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.249776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.250082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.250358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.251095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=afdf5eda0a634fe48781ef984f7bf496) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:12.251405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:12.252844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be7e51-5208-46da-a89f-cebe5da8f804 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:12.259417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 426/832] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/role_assignments?user.id=afdf5eda0a634fe48781ef984f7bf496&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:12.441312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f7736-6f87-4da6-b4e0-34412a3b7f7c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.441842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f7736-6f87-4da6-b4e0-34412a3b7f7c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.441924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f7736-6f87-4da6-b4e0-34412a3b7f7c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.443498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 407/833] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:12.449507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.449894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.450111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.474269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:12.474269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:12.549887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 427/834] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:12.817508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f7736-6f87-4da6-b4e0-34412a3b7f7c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:12.870932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:12.923630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f7736-6f87-4da6-b4e0-34412a3b7f7c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:12.966613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:12.967244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:12.967522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:12.967845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:12.979130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:12.983908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:12.984847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:12.985730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 408/835] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:12.991180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.075184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.094602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104d5b-3b71-44b0-8075-408f36f53564 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.130126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.130742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.131021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.131298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.131967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.132271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.133643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.147390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 428/836] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.148722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.257232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3bb6-4d8b-4320-b1f6-857a4e1c9219 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.270008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.294446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.295081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.295358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.295628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.306966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.308418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4d1007c7-4c16-4048-b83f-d1b0df17560c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:13.323877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.326165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:13.328796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:13.328796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:13.328796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:13.328796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 409/837] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.333788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.405117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5013ab3-7f76-45b1-9dd6-1ce10aad9049 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.406067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5013ab3-7f76-45b1-9dd6-1ce10aad9049 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.406345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5013ab3-7f76-45b1-9dd6-1ce10aad9049 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.408203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 410/838] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:13.414127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.414470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.414680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.434602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:13.435994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:13.441815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac3a7b-2b9c-46ca-ba88-17a139b7b539 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.477562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.478298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.478662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.479046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.479703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.480007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.481386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.499244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 429/839] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.500615 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.504330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.518802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 411/840] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:13.603858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980943-4d7a-4583-add5-6f3aa94ea48b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.638932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.640098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.640384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.640658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.647993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.649461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-729db8b4-ab0e-4e96-a9ae-93a3e6cc193d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:13.661928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:13.664119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 03:27:13.666432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:13.669804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 430/841] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:13.670891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.772679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.783037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88719e84-f3bc-4a87-8fb3-1ce666724b1b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:13.812379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e27135-c1d6-4b03-a212-4db89806548c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.812651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e27135-c1d6-4b03-a212-4db89806548c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.812928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e27135-c1d6-4b03-a212-4db89806548c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.814560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 431/842] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:13.818592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:13.819212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.819490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.819767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.819870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:13.820160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:13.820433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:13.820538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:13.820796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:13.822273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:13.839954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:13.842230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 412/843] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:13.842350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:13.842431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.905494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:13.914159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 432/844] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:13.922820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:13.955249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d3fa-f44a-4c35-a206-a1d1aa4b5379 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.003684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.004337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.004621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.004893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.019293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:14.025616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.026644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:27:14.027523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:14.029906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 413/845] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.033261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.051784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.065623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c0c5-a2d0-4044-8cb9-3fd346fc4d9c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.113706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.114606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.114902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.115180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.171844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fb592-eab8-40bd-b95a-182fea2399c9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.191367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.199993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.201459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.212057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.212680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.212966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.213242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.213980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.214286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.215665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.225020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 414/846] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:14.225876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.300115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.312973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 433/847] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:14.313865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.329820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbc0e-2fec-4c10-8474-32313828908e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.364072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.364702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.364982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.365250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.365873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.367236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c84dab15-dd07-4c04-a4de-324fbc8fdcbe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.376686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.382004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:14.382903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 415/848] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.383716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d57a-130b-4340-86ac-e9150ea7ba93 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.383716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d57a-130b-4340-86ac-e9150ea7ba93 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.383716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76d57a-130b-4340-86ac-e9150ea7ba93 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.383716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 416/849] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:14.383716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d57a-130b-4340-86ac-e9150ea7ba93 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.420243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.427506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f954b-3f82-40f7-a045-92424c0d4385 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.463528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.464173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.464452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.464724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.477315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.478809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.485219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76d57a-130b-4340-86ac-e9150ea7ba93 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:14.493359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.494498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:14.495428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:14.495428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.495428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:14.495428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 434/850] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.495664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.520008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.520636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.521007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.521305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.524401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.532996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.534442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c857266d-52ae-4f81-8b2b-79f4d1ee551f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:14.548969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.549966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:14.550972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:14.550972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:14.550972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:14.550972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 417/851] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.551379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.551526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.551787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.570115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:14.571318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:14.601718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4538ca-1732-433b-8108-a0cfcdec69fe None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.635013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.635616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.635894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.636162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.649865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 418/852] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:14.650073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.650073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.650264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.650351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.650351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 435/853] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.650351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.662210 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.741885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ff11e-39c0-4fb6-8c2d-275d2666845c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.756643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c7d5-513f-466e-bfbb-543cc10fa211 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.761027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.779562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.780885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.781174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.781568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.782296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.782604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.784078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.792390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.793000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.793278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.793547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.794216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.794517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.795964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.797506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 419/854] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.798768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.817164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 436/855] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.818124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.886810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:14.909002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf675dcc-34e8-4894-b5e6-614ee8c3cb09 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.919422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11d368-4cf6-4988-9f31-b0e5d1d3054a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:14.942921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.943521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.943795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.944076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.944681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:14.944978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.946378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.950808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 420/856] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:14.951535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:14.953783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:14.954436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:14.954716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:14.954989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:14.963487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:14.964995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:14.978573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:14.979817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:14.980802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 437/857] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:14.981404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.017092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.088164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9839852-3a16-4ec0-b595-31b13ef7bc4b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.099599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007be60-0b50-41ea-8ed5-628c50605822 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.132260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.135825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.136800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.137286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.137884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.138186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.138829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.139089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.139356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.140469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.141968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.147522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.149536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.150718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.151685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:15.152682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 438/858] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.153508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:15.168570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.169635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 421/859] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.175128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.275017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242b3c8-749b-4f61-b8cf-58d8db27b9a1 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.288465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b84d0f-452c-4087-b556-6753d1028ad4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.291070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.310735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.311368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.311643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.311913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.312665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.313013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.314462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.331993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.332667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.332951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.337883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.338120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 439/860] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.338232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.338311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.338384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.338384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.344143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 422/861] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.347287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.393995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.443702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2d51d-1e39-4755-a99e-031e1be99e39 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.466878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25d0e5-448b-4113-bd98-79b31eb9eb49 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.487260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.487880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.488157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.488430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.489214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.489521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.491064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.503333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 440/862] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.504445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.509891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.510538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.510819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.511092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.546958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.583198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.585376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.615897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142de01-0e0b-4c67-9175-b034fdd682cd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.630753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.652786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.653514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.653822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.654104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.654736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.655068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.656662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.661164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 441/863] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.662103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.707147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 423/864] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:15.712992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.785589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427cd53-08ba-4151-ba93-9b5a878741e0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.811013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:15.836848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.840009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.840009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.840009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.840009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=86600b9afdbf43808b4745828a1d3756) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:15.840009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.841592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.848005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 442/865] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/role_assignments?user.id=86600b9afdbf43808b4745828a1d3756&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:15.855207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01978272-ce70-4c3e-9b20-44128619398b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:15.904297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:15.904964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:15.905421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:15.905694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:15.918225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:15.919803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:15.937906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:15.938924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:15.939842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:15.939842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:15.939842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:15.939842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 424/866] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:15.948437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:15.997502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.079288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa1ee24-992c-4a3b-a371-2a470f5c584a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.127995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.128621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.128887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.129162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.129843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.130156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.131517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.145400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 443/867] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.150500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.261255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9074b21-18a4-4e01-bcb4-b74f2f82b65a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.286171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.297151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.297860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.304892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.304892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.305228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.306701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:16.318163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:16.319144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:16.320106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 425/868] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:16.325141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.428515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.432180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503f7334-3d99-4386-b1ef-3562983c4dc9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.467062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.468213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.468495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.468766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.469457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.469777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.473190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34dbfe-d775-4b0d-be3b-2cec47e0c593 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.484673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 444/869] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.490856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:16.594860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6015a8f-51f5-4cc7-ae26-9ab286745ed9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:16.635362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:16.635977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.636261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.636537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.637273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=f5c5765e56b848d4a8091de1570bfbc5) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:16.637583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:16.639053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd9d2b-5e67-4f83-ae68-b4f24b349c8a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:16.646486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 426/870] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:16 2022] GET /identity/v3/role_assignments?user.id=f5c5765e56b848d4a8091de1570bfbc5&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:16.878302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8012e-1397-4190-97a1-348cd1bcd466 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.878587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8012e-1397-4190-97a1-348cd1bcd466 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.878868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8012e-1397-4190-97a1-348cd1bcd466 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.880211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 445/871] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:16.886102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b09d-379e-44a5-a530-85b7d91cb5ec None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:16.886391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b09d-379e-44a5-a530-85b7d91cb5ec None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:16.886667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54b09d-379e-44a5-a530-85b7d91cb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:16.906519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7b54b09d-379e-44a5-a530-85b7d91cb5ec None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:16.907727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7b54b09d-379e-44a5-a530-85b7d91cb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:16.944093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:16.983011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 427/872] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:17.259928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8012e-1397-4190-97a1-348cd1bcd466 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:17.370992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8012e-1397-4190-97a1-348cd1bcd466 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:17.412226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d217c-6308-48e5-b42f-33a58b3918f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:17.412840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d217c-6308-48e5-b42f-33a58b3918f1 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.413116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d217c-6308-48e5-b42f-33a58b3918f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.413383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d217c-6308-48e5-b42f-33a58b3918f1 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.414076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d217c-6308-48e5-b42f-33a58b3918f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:17.415564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d217c-6308-48e5-b42f-33a58b3918f1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:17.500776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 446/873] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:17 2022] POST /identity/v3/services => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:17.731704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c329-0ce2-45ef-abcb-efadec8216f8 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.732810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c329-0ce2-45ef-abcb-efadec8216f8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.733328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8c329-0ce2-45ef-abcb-efadec8216f8 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.735297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 428/874] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:17.745130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b941-06c3-41dc-aac6-bc0277e67291 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.745736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b941-06c3-41dc-aac6-bc0277e67291 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.746243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72b941-06c3-41dc-aac6-bc0277e67291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.765748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7b72b941-06c3-41dc-aac6-bc0277e67291 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:17.767355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7b72b941-06c3-41dc-aac6-bc0277e67291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:17.783720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:17.854248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 447/875] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:17.987508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffa76-8698-44fd-a1f4-d50230707643 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.988112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffa76-8698-44fd-a1f4-d50230707643 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.988583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ffa76-8698-44fd-a1f4-d50230707643 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:17.990259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 429/876] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:17.995911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:17.996204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:17.996487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.017412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:18.018919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:18.092865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 448/877] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:18.136694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ffa76-8698-44fd-a1f4-d50230707643 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.251351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ffa76-8698-44fd-a1f4-d50230707643 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.286590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.287204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.287487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.287764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.288417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.289887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.386434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 430/878] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:18 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:18.386780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.478974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.503154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29ac3-e399-4069-b964-111349bbffcf None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.547918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.548569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.548856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.549133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.549723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.551201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:18.560643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:18.561725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:18.562635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 449/879] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:18.567835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.607898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.684720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71eaf94-3a35-403e-b81d-e976ffcb6b9f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.722367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.722988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.723270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.723547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.724188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.724491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.725897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99276eb8-101f-43ed-958c-0cc8f7076db7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.731427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 431/880] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:18.737468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:18.748591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc259a6-4750-4777-a749-b0e2bc2f2a80 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.749095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc259a6-4750-4777-a749-b0e2bc2f2a80 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.749173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc259a6-4750-4777-a749-b0e2bc2f2a80 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.750753 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 432/881] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:18.756481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.756717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.756974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.776867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:18.778406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:18.858744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 433/882] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:18.869839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a059485-549f-468c-86b6-8588756f5fe2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:18.905001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:18.905886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:18.906331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:18.906758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:18.907532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:18.907974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:18.909584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:18.911988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:18.916059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 450/883] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:19.133976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.163286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.248187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c329e24-4ab5-47f3-9cbb-d46985ba4fda None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.285864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.286502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.286782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.287049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.298541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:19.303318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:19.304259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:19.305118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 434/884] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:19.310461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.414861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fc9ec-ae5b-41b3-9c61-6677f3d3f79f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.451576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.453072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.453596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.454088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.454965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:19.455487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.457338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef59d7-cc88-4e60-aedf-1235fa821e63 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.466933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 451/885] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:19.475117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.535420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e30c4-bdba-4e5a-bdfa-dc66aa2b10f1 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.535710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e30c4-bdba-4e5a-bdfa-dc66aa2b10f1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.535980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e30c4-bdba-4e5a-bdfa-dc66aa2b10f1 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.541631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 452/886] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:19.543295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.543583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.543863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.563278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:19.564488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:19.567227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.585855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d77ecc-b063-40a7-a0c1-5e00c62e2386 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.629382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.629974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.630258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.630532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.631698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:19.645070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 453/887] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:19.647569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.649427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:19.665019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:19.666066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:19.667055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:19.667055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:19.667055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:19.669083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 435/888] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:19.675742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.785626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735261a6-aae9-43fd-be24-0a3b5ce7d857 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.822349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.822968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.823248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.823527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:19.824176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:19.824483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:19.825979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:19.838492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 454/889] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:19.847361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.944186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:19.955668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663090c-c460-4ddf-b912-2dce53974c14 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:19.990860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:19.991493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:19.991776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:19.992059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.000729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.001999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.003972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.008885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:20.014104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.015324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:20.016755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 436/890] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.020899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.078763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3057ba9-2c37-459c-9078-44628925da1a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.131374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.132024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.132479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.132879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.133494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.135084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.145355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96e54d-d778-4177-8332-18f75293b503 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.146669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.147656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:20.148503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 455/891] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.153613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.193705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.194949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.195795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.196265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.197403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.197917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.200640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.224777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 437/892] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:20.230476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.276337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b731eb1-4436-456c-ad32-e379c243b15e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.293447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.293817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.312822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.313843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.314380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.314865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.315685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.316191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.317742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.323090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 456/893] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.329059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.343669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5976bde-8d06-41c1-a539-3ad766851ea3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.391992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188c3c4-fc41-4c0f-be78-7eaa36378c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.393174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188c3c4-fc41-4c0f-be78-7eaa36378c09 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.393667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188c3c4-fc41-4c0f-be78-7eaa36378c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.394373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188c3c4-fc41-4c0f-be78-7eaa36378c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.447679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9eb50-14a4-47ea-abae-4a0ff2ae1eb0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.472646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188c3c4-fc41-4c0f-be78-7eaa36378c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.474623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188c3c4-fc41-4c0f-be78-7eaa36378c09 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.483656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.484360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.484707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.485068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.485802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.486185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.487621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae78ca-bfa7-4756-89c1-e186c97d0d72 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.493219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 457/894] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.495328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9565d-ce11-4593-9c0f-91b7bc084966 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.495613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9565d-ce11-4593-9c0f-91b7bc084966 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.495890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9565d-ce11-4593-9c0f-91b7bc084966 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.497333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 458/895] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:20.499236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9565d-ce11-4593-9c0f-91b7bc084966 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.543205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.551619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.594754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 438/896] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:20.594754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.594754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.594754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.612380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:20.613593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:20.613884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9565d-ce11-4593-9c0f-91b7bc084966 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.655696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.656777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.657056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.657324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.658053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] RBAC: Adding query filter params (interface=public, service_id=c663bb63ca2d45b4a3f2412c7786c6f0, region_id=RegionOne) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:20.658360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.660392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.672922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 459/897] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/endpoints?service_id=c663bb63ca2d45b4a3f2412c7786c6f0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:20.672922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.689485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 439/898] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:20.694686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.784925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c737f-ce9c-4712-9787-1ab8793085b9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.795875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.812886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:20.822022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.822988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.823464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.823931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.831784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f65af7-eea7-4b18-8de0-89721e0296cc None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:20.837753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.839452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:20.855706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:20.856846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:20.858397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:20.858397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:20.858397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:20.860581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 460/899] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:20.866431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.884551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:20.885318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:20.885587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:20.885885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:20.886628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:20.888582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:20.902390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 440/900] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/services => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:20.976092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:20.992684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7446d-112f-44e5-bb16-cf036c32d9b8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.032551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.033184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.033466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.033795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.034460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.034769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.036239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5ab4c-0f5c-46d9-888c-aade35fab956 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.050275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 461/901] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.056003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5da1-ec3e-4fcc-9cae-4ac4836d720d None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.056003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5da1-ec3e-4fcc-9cae-4ac4836d720d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.056003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5da1-ec3e-4fcc-9cae-4ac4836d720d None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.056003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 462/902] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:21.056330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda5da1-ec3e-4fcc-9cae-4ac4836d720d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.084235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.096715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f126e-9d05-433b-95bf-08384cd82146 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.133114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.134082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.134357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.134633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.135222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.136598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-3a89c46c-5399-4910-b381-d18e3c45d9bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.146365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.147416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:21.148381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 441/903] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:21.149251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.149251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.149251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.168409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:21.169615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:21.179506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda5da1-ec3e-4fcc-9cae-4ac4836d720d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.180345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.217785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.218437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.218721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.219068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.226319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.227794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:21.240661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:21.241663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 463/904] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:21.242604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.247150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 442/905] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:21.254709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.334713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.355398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3beeb6-f857-426b-a852-ca8e89dce55d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.362689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a6ad-7b25-4bc6-a299-482774d445a6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.398118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.399028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.399521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.399968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.400768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.401233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.402391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.402980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.403191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.403562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.403972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.405443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.405879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.407538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.414546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 464/906] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.417020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.428170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 443/907] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.434793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.438924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.546674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874f43-e700-49b2-be85-e19e00a925f8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.549806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c42423-0e81-43f0-9259-30dd1b4e9c8d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.585607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.586168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.586454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.586732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.587366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.587596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.587717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.588198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.588494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.588740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.589030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.589487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] RBAC: Adding query filter params (role.id=82204103dcb44e28bf9cda182b99798b, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=f5c5765e56b848d4a8091de1570bfbc5) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.589817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.591229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.594285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 465/908] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.595470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.602253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 444/909] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/role_assignments?user.id=f5c5765e56b848d4a8091de1570bfbc5&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=82204103dcb44e28bf9cda182b99798b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.603492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.606377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.700010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.731729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53cd39-c097-4d6f-969f-f9f50d247a79 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.751766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2b2147-3a02-4693-a423-8a12afe2085f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.771195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984ff9e-0b1e-4743-ba6b-248acce4b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.771815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984ff9e-0b1e-4743-ba6b-248acce4b0ce None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.772093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984ff9e-0b1e-4743-ba6b-248acce4b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.772363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984ff9e-0b1e-4743-ba6b-248acce4b0ce None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.773014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984ff9e-0b1e-4743-ba6b-248acce4b0ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.774881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984ff9e-0b1e-4743-ba6b-248acce4b0ce None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.789414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.790275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.798925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.798925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.798925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] RBAC: Adding query filter params (interface=public, service_id=38938687ec9e45dda54aec6d0b3079b4, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:21.798925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.798925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.799353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 445/910] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/endpoints?service_id=38938687ec9e45dda54aec6d0b3079b4&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:21.805804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:21.863255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 466/911] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:21 2022] POST /identity/v3/services => generated 241 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:21.927843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952bc9d-aad8-4417-8196-3eca4c4e81b3 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:21.963651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:21.975336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0e36c-1e93-4bf8-b843-fe0d89d9bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:21.975965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e36c-1e93-4bf8-b843-fe0d89d9bd91 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:21.976250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e36c-1e93-4bf8-b843-fe0d89d9bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:21.976523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0e36c-1e93-4bf8-b843-fe0d89d9bd91 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:21.977142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e36c-1e93-4bf8-b843-fe0d89d9bd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:21.978592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0e36c-1e93-4bf8-b843-fe0d89d9bd91 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:21.986397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 446/912] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:21 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:27:22.903734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9553374-f7d5-47fa-a32e-25066479326c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.904248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9553374-f7d5-47fa-a32e-25066479326c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.904414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9553374-f7d5-47fa-a32e-25066479326c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.906448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 467/913] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:22.911838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:22.912127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:22.912403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:22.930836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:22.932039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:23.006093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 447/914] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:23.287788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9553374-f7d5-47fa-a32e-25066479326c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.361510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.399651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9553374-f7d5-47fa-a32e-25066479326c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.435641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.437026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.437454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.437913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.438671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.440199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-85e163fd-cf1c-4ac2-86dc-105aad3c6a0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:23.449488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:23.450819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 03:27:23.451961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:23.454546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 468/915] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:23.460417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.550998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ae1f-59d6-44cb-87f6-5a01da03340b None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.551195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ae1f-59d6-44cb-87f6-5a01da03340b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.551453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5ae1f-59d6-44cb-87f6-5a01da03340b None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.553055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 469/916] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:23.558237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.558519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.558793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.573448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e04786-d19c-423d-bd4e-34d328f09a9c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.578218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:23.579414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:23.604014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.618842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.620953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.620953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.620953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.620953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.621654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.623816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.629732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 448/917] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:23.635053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.669801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 470/918] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:23.744687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02d5c5-61b5-48a3-9f78-6097b17c454e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.780716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.781334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.781616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.781927 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.782561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:23.782865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.784349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c00033-4000-44b3-927b-80d49c3e1b13 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.789870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 449/919] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:23.798923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:23.855769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58632d66-f4dd-4652-9701-31ad138df9ce None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.855959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58632d66-f4dd-4652-9701-31ad138df9ce None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.856235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58632d66-f4dd-4652-9701-31ad138df9ce None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.858491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 450/920] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:23.863289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.863701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.864458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.866798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.888507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:23.890448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:23.910638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc38a4e-d058-4dd2-bf91-b11f322c577c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:23.949009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a700d-e9e7-4d6c-b65f-775cc0933a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:23.949626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a700d-e9e7-4d6c-b65f-775cc0933a07 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:23.949949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a700d-e9e7-4d6c-b65f-775cc0933a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:23.950223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a700d-e9e7-4d6c-b65f-775cc0933a07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:23.950883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a700d-e9e7-4d6c-b65f-775cc0933a07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:23.952287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a700d-e9e7-4d6c-b65f-775cc0933a07 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:23.954689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:23.976846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 451/921] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:23.977496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.024127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 471/922] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:24.025875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0aa55-6856-4f79-be5f-b9aa146f477d None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.026390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0aa55-6856-4f79-be5f-b9aa146f477d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.026894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0aa55-6856-4f79-be5f-b9aa146f477d None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.028694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 472/923] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:24.039437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.039741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.043887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.063701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:24.065154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:24.104290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db857-d589-4fd2-b0b6-c065d9eca178 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.159035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.160035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.160563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.161060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.163657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 473/924] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:24.175729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:24.181224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:24.182264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:24.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.183864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 452/925] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:24.190166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.251489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.252946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.300773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.318151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889b0c9-8049-46bb-9d10-6a68adb18ca5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.371589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.372298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.372640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.373021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.373567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65af6be-595d-48e0-a2b1-a53e1e84910e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.373870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.374238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.375942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.386913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 474/926] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.393084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.415472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.416496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.417012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.417486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.418334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.420203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:24.430233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:24.431286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:24.432138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.434713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 453/927] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:24.435753 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.506183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc7faa-60ec-406b-a569-b729ea6aff1d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.517680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.542549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.543211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.543468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.543705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.543814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.547072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044a042-eea2-4abe-9d7f-21edcf55fe5d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.555128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.557052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:24.572721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:24.573862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:24.574802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:24.574802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:24.574802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:24.579331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 475/928] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:24.580127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.589567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.590458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.590913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.591331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.592121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.593493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:24.603036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:24.604187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 03:27:24.605298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:24.609020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 454/929] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:24.609955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.693964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297957b9-8a7b-46d5-9336-f084afaed970 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.716738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1a8d3-25e6-4856-8e48-1a90a7511221 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.728203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.728821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.729105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.729381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.730046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.730358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.731724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.736469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 476/930] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.737263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.758051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.758906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.759363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.759896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.760861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.761311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.762850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.769710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.777101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 455/931] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.778129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.806709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:24.865042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c3e25-013e-47d6-9657-88983d991eb4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.893998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df3b5b-7092-460f-8d8a-ccb8b3dd39a1 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:24.902697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.903304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.903586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.903850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.904614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.904916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.906347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.911142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 477/932] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.911142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:24.934049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:24.934726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:24.935010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:24.935283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:24.936453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:24.936750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:24.938120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:24.943032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 456/933] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:24.943758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.021563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.032638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c12be5-ee43-4b78-bf14-2546280ab3ab None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.034831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.047496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2b985-afd9-44ec-8d30-5f29730cdf83 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.074205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.075445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.076908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.077661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.084352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.084996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.085279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.085550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.086223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.086523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.087881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.088027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.090403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.093559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 457/934] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.094394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:25.113252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.114467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:25.115471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 478/935] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:25.118405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.219717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee227aa-7901-4559-92e7-b0d4a0c983e9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.233527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93f209-37f3-48cc-93d8-21b4f8f298dc None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.256321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.256939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.257221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.257493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.258236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] RBAC: Adding query filter params (interface=public, service_id=c4179bff7d834691a8785961caeaada6, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.258548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.259909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.265986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 458/936] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/endpoints?service_id=c4179bff7d834691a8785961caeaada6&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.270935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.274283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.274831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.275113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.276053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.276053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.277351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.292859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.355108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 479/937] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:25.355108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.361020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.394957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da31d40-8cb2-40a0-9c8f-33f76af7505e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.455074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.455074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.455074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.455074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.455521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.455521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.461797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.489651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 459/938] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.492521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.517478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ff2aa-886b-4edc-9249-96551f238097 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.557138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.557783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.558079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.558387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.558963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.560855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.573933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 480/939] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/services => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:25.575892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.613189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7020a-bc72-4118-a542-0b30d737d9c9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.653603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.654567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.655021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.655436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.667116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.668917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:25.686488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:25.687729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:25.688848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:25.688848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:25.688848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:25.690746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 460/940] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:25.701811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.778228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:25.811232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab435-1ad1-48d1-b2df-fa7cbc50b7ee None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:25.853209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:25.854147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:25.854592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:25.855014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:25.855811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:25.856281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:25.857896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:25.875443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 481/941] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:25.881161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:25.988991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad35555-5c0b-48cf-a3e2-2d83ed6cdc2c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.012718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.027688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.028323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.028598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.028865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.036198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.037709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-c4db50a8-bada-415e-87a3-6167626e0c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:26.048964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.049955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.051068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 461/942] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.058942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.131658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bcfa-f652-4bf9-8ace-9084e566ef64 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.131850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bcfa-f652-4bf9-8ace-9084e566ef64 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.132112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02bcfa-f652-4bf9-8ace-9084e566ef64 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.133859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 462/943] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:26.139433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.139713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.139982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.161855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:26.163142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:26.177417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e941e-50fb-4995-890d-3550f5bce529 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.209563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.215736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.216736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.226648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.226648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.226648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:26.226648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.226648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.232290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 482/944] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:26.241827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.262762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 463/945] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:26.349481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a30f45-0aec-4ff2-a2e9-35c4454344fc None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.384721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.385736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.386264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.386736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/f5c5765e56b848d4a8091de1570bfbc5/roles/82204103dcb44e28bf9cda182b99798b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.389841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=f5c5765e56b848d4a8091de1570bfbc5, role_id=82204103dcb44e28bf9cda182b99798b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.391481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.485071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 483/946] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:26 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/f5c5765e56b848d4a8091de1570bfbc5/roles/82204103dcb44e28bf9cda182b99798b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:26.532466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.650226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffdc3e-2cb6-4665-b73a-d1de3aa9c1c4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.664875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.687144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.687743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.688023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.688299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.688935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.690416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.693547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING keystone.server.flask.common [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:27:26.737053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.sql.core [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:26.737053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:27:26.737053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [parameters: {'id': 'e0d45ea2013f45e38b605b6a40dc791e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:27:26.737053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81789) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0d45ea2013f45e38b605b6a40dc791e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0d45ea2013f45e38b605b6a40dc791e. Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:26.754720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 03:27:26.755629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:26.756625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:26.757585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:26.758796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:26.759621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [parameters: {'id': 'e0d45ea2013f45e38b605b6a40dc791e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.760551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.761386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e0d45ea2013f45e38b605b6a40dc791e. Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:26.767489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 464/947] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Aug 24 03:27:26 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.771310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:26.831974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:26.890537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014be21-ab04-4f39-ab6c-1bd1f049dc25 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:26.927614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:26.928531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:26.929000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:26.929414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:26.936744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:26.938471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-03cc5ba8-7e4f-49a9-9063-cffa966948cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:26.950579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:26.951782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:26.952915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:26.955014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 484/948] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:26.961563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.072094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f41e7-a470-4479-82a7-3fb1139981cc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.110585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.111205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.111492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.111768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.112507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:27.112810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.115954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5101321-776f-42f4-b107-d8e21dbefddf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.135756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 465/949] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:27.409213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfea4e4-c01e-4383-8ce7-582c7ed45acb None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.409742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfea4e4-c01e-4383-8ce7-582c7ed45acb None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.409742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfea4e4-c01e-4383-8ce7-582c7ed45acb None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.411351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 485/950] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:27.416679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d8af5-c43b-4087-af95-07713f01257b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.416968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d8af5-c43b-4087-af95-07713f01257b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.417242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d8af5-c43b-4087-af95-07713f01257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.436417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-145d8af5-c43b-4087-af95-07713f01257b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:27.437964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-145d8af5-c43b-4087-af95-07713f01257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:27.468415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.515420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 466/951] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:27.719345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfb867-16e3-42ba-b1e8-d265019fe1f8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.719741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfb867-16e3-42ba-b1e8-d265019fe1f8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.720118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfb867-16e3-42ba-b1e8-d265019fe1f8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.721846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 486/952] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:27.727274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.727693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.728076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.746273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:27.747521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:27.784513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfb867-16e3-42ba-b1e8-d265019fe1f8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:27.829867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 467/953] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:27.895417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfb867-16e3-42ba-b1e8-d265019fe1f8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:27.906833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:27.932893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:27.933992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:27.934479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:27.935042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:27.935968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:27.937639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:27.946870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:27.948033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:27.948945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:27.952255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 487/954] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:27.961788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.054931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.067795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d5555-37fa-4145-9e55-0b42b4ab2f38 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.104844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.106618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.106914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.107491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.108131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.108434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.109919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.115578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 468/955] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:28.121280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.121443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.246182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202755b5-cb2a-4d80-9a81-da761be9a395 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.258518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaea9b6-ee0e-4a4b-a952-3aa89b5cea47 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.290963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.292061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.292338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.292749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.293469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.295404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:28.306243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:28.307313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:28.308333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:28.309112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.309112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.309112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.309318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 488/956] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:28.309395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.309395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.309395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.313790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.313926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.321935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 469/957] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:28.362815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.432737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ecd20-fa96-4e48-b5bb-fce8b1b6ee39 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.474127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.474751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.475031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.475306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.476436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.476436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.477586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e0f58-a084-4307-bddd-864c1553d071 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.483100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 489/958] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:28.488679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.511521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.554747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ea02-309d-4b37-9c82-51fdd2696846 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.555062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ea02-309d-4b37-9c82-51fdd2696846 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.555297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660ea02-309d-4b37-9c82-51fdd2696846 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.556925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 490/959] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:28.562719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.563000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.563273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.582272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:28.583452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:28.613623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b47505-74a5-437e-bf7c-99a8abad8258 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.657321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 491/960] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:28.667481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.668392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.668901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.669932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.670844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:28.671354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.672920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.679074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 470/961] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:28.685065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:28.722127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:28.789778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86367c3-b5e0-4a62-bee3-1679b45e6954 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:28.827006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:28.827664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:28.827953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:28.828229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:28.828910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:28.830322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:28.911340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 492/962] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:28.940976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.036598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.058526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e2dea-f6fe-4b33-aff7-d788576c2794 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.105360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6d5f4-3a06-4f7e-8e76-29980728ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.106038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d5f4-3a06-4f7e-8e76-29980728ab6f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.106265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d5f4-3a06-4f7e-8e76-29980728ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.106513 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6d5f4-3a06-4f7e-8e76-29980728ab6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.117559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6d5f4-3a06-4f7e-8e76-29980728ab6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-48c6d5f4-3a06-4f7e-8e76-29980728ab6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:29.122378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.123925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:29.124819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 471/963] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:29.132509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.197192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1c26-bb80-4315-a187-4bd49fd230c1 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.197511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1c26-bb80-4315-a187-4bd49fd230c1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.197731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad1c26-bb80-4315-a187-4bd49fd230c1 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.199951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 472/964] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:29.206026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.206311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.206633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.225184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:29.226555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:29.234629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.249135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c448ef-e4aa-4232-a0d1-6a9446a928d9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.286267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.287143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.287579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.288030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.288955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.289435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.290898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.304980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 493/965] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.306328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.316649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 473/966] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:29.415108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b425ce5-23df-4139-ac44-4dabe6b4a1e1 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.454395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.456123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.456633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.457105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.469436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.471254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:29.486905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.487890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:29.488859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:29.488859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:29.488859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:29.488859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 494/967] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:29.494162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.574309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.597307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab7d66-7880-4f4e-9fc1-f8f483a5d554 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.614894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.626374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.634636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.635310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.635599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.635872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.636529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:29.636834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.638282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.650718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 474/968] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:29.656013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.736000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d475f89-2ece-4623-869c-bfc97985d5fb None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.776683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf4364-410a-4a0b-aef8-d22b5770d568 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:29.779704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.781253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.781690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.782001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.782668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.784119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.786718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING keystone.server.flask.common [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 03:27:29.818232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.823391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.sql.core [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:29.823391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:27:29.823391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [parameters: {'user_id': '497591a365d243859df4dc9e7e36010a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:27:29.823391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81788) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 03:27:29.828392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:29.829348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:29.829842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:29.830287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:29.832195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:29.836102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application yield resource Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application next(self.gen) Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise self.value Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application session.commit() Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 03:27:29.837092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.session.flush() Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application compat.raise_( Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 03:27:29.838044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 03:27:29.839548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application conn.query(q) Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application result.read() Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 03:27:29.840434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [parameters: {'user_id': '497591a365d243859df4dc9e7e36010a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.842897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 03:27:29.845450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 495/969] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Aug 24 03:27:29 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:29.847861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.848999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:29.850714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:29.869597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:29.870735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:29.871724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 475/970] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:29.876827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:29.923984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:29.973178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee497f5-7f37-4e63-b375-d2e4c477bf10 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.014982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.015534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.015835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.016285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.023053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900309-660a-424b-84b8-7d68f3a2a107 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.024395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.026136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:30.039624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:30.040702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:30.041696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 496/971] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:30.046808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.070535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.071556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.071979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.072755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.074059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.074508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.076728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.101304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 476/972] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Aug 24 03:27:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:30.107055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.170717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.199742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f2288-2a9d-40a3-8007-5b38ea4e1f42 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.231630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.233069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b589-6eb2-47eb-a829-7e554d1a3a42 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.246259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.247086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.247362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.263110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.263110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.263110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.263110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b03ac7-cf3c-4034-b54b-1ced1cfb6663 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.274758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.275647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.276180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.277466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.297916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 497/973] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:30.334742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467b96-b89e-4eba-ade5-c923019d81e4 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.335244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467b96-b89e-4eba-ade5-c923019d81e4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.335624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67467b96-b89e-4eba-ade5-c923019d81e4 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.337381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 498/974] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:30.343259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.343661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.344041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.364455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:30.366337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:30.377482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.379938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.443324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.465496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 499/975] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:30.521113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 477/976] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:30.527429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.636319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985043b-2b6e-45c7-b017-9e7c056cf463 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.650088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.672216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b91280-e38a-421b-b871-618991167dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.672850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b91280-e38a-421b-b871-618991167dce None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.673126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b91280-e38a-421b-b871-618991167dce None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.673396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b91280-e38a-421b-b871-618991167dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.684731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b91280-e38a-421b-b871-618991167dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.686251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b91280-e38a-421b-b871-618991167dce None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-f0b91280-e38a-421b-b871-618991167dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:30.701295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:30.702367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:30.708680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:30.708680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:30.708680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:30.708680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 500/977] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:30.710174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.735945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b91280-e38a-421b-b871-618991167dce None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.823469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554438fd-253b-4cce-9027-d43f00de48c6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.840902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b91280-e38a-421b-b871-618991167dce None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.860309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.860924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.861203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.861478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.862151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:30.862454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.863820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.879872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 478/978] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:30.880076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6340559-5ef8-47ed-89b6-781e1afba401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:30.880076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6340559-5ef8-47ed-89b6-781e1afba401 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.880076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6340559-5ef8-47ed-89b6-781e1afba401 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.880076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6340559-5ef8-47ed-89b6-781e1afba401 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.880384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6340559-5ef8-47ed-89b6-781e1afba401 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:30.880384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6340559-5ef8-47ed-89b6-781e1afba401 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:30.880970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:30.884823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:30.965875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 501/979] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:30 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:30.982232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6727-6474-4700-93b7-5c949b03c97c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.982577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6727-6474-4700-93b7-5c949b03c97c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.982796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf6727-6474-4700-93b7-5c949b03c97c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:30.984364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 502/980] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:30.985258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc507b-ad82-41f1-9e35-ddfc1443b873 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:30.990244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:30.990586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:30.990810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.009644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:31.010915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:31.033340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.038940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.039605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.039886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.040162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.049143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.052080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:31.062817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:31.063834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:31.064760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 479/981] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:31.069984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.099433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 503/982] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:31.143366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.186451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aa207-b225-4d90-a82f-fe198b06ba4e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.221425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.222064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.222341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.222609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.223292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.223592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.225016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.237541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 480/983] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:31.243317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.344696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c7129-072e-4550-b0e1-bebc1d068cc8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.370854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.383315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.383936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.384543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.384821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.385724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] RBAC: Adding query filter params (role.id=82204103dcb44e28bf9cda182b99798b, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=f5c5765e56b848d4a8091de1570bfbc5) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.386072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.387520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.394453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 504/984] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/role_assignments?user.id=f5c5765e56b848d4a8091de1570bfbc5&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=82204103dcb44e28bf9cda182b99798b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:31.500141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2820bb9-2f7e-4dc4-86b5-9392ae9c5912 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.524414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.542506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.543149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.551484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.551484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.551484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.551484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:31.555311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:31.556315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:31.557744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 481/985] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:31.562572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.583630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.676049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615339-0334-4f5d-ba75-1e49eee5485a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.711659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.712270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.712551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.712846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.713484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.713809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.715172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.720920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 505/986] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:31.726986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.835898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df3778-276b-4860-95de-ccb300128ee9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:31.870343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:31.870961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:31.871242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:31.871513 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:31.872144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:31.872478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:31.873871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:31.883677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 482/987] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:31.884940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:31.971739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:31.990237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669985eb-2482-4c47-bfaf-c830b8da2eec None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.027275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.028267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.029489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.029946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.030830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] RBAC: Adding query filter params (interface=admin, service_id=c4179bff7d834691a8785961caeaada6, region_id=RegionOne) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:32.031288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.032821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34aa09-68df-4033-920d-d40ae970e1b4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.038548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 506/988] 10.222.0.40 () {56 vars in 1249 bytes} [Wed Aug 24 03:27:31 2022] GET /identity/v3/endpoints?service_id=c4179bff7d834691a8785961caeaada6&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:32.044269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:32.101502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:32.155300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac29b1-2bf9-416f-94c0-d5f5d2f13385 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:32.195707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f17b5-0d39-4dcd-b6d1-945820211717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:32.196551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f17b5-0d39-4dcd-b6d1-945820211717 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.196975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f17b5-0d39-4dcd-b6d1-945820211717 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.197433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f17b5-0d39-4dcd-b6d1-945820211717 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.198214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f17b5-0d39-4dcd-b6d1-945820211717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:32.199713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f17b5-0d39-4dcd-b6d1-945820211717 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:32.207533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 483/989] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:32 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:32.946494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392ad21-62f7-4a71-8365-a9b961ae77e3 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.947024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392ad21-62f7-4a71-8365-a9b961ae77e3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.947024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392ad21-62f7-4a71-8365-a9b961ae77e3 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.948382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 507/990] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:32.953985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc83c0e-0bb1-4aaa-81b1-1dc1e4b76012 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:32.954281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc83c0e-0bb1-4aaa-81b1-1dc1e4b76012 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:32.954563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc83c0e-0bb1-4aaa-81b1-1dc1e4b76012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:32.973880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-dfc83c0e-0bb1-4aaa-81b1-1dc1e4b76012 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:32.975095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-dfc83c0e-0bb1-4aaa-81b1-1dc1e4b76012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:33.045522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 484/991] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:33.328399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392ad21-62f7-4a71-8365-a9b961ae77e3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.431522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828c6b-3ce8-481f-90ac-c95a021b626c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.432055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828c6b-3ce8-481f-90ac-c95a021b626c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.432055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828c6b-3ce8-481f-90ac-c95a021b626c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.433562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 485/992] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:33.442340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.442626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.442902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.448418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392ad21-62f7-4a71-8365-a9b961ae77e3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.469059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:33.473132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:33.503252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.504019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.504326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.504594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.505176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.506604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.512398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:33.520846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:33.523300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:33.524248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 508/993] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:33.531679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.549866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.551592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 486/994] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:33.649790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f9324-99b9-4319-b2dd-468ebeebac14 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.687149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.687771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.688074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.688352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.689007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:33.689297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.690859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.696921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 509/995] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:33.702985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.825989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b26b6-53e7-42ac-b0b7-e8ef74c60132 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:33.856197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.867074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:33.867690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:33.867971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:33.868242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:33.868888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:33.869189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:33.870609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:33.877128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 487/996] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:33.883015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:33.923467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.945843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:33.974361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fadbd-0277-4f21-b1bd-8e41ff22624a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.000928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90c594-8c13-4f95-9b4b-eec3b934bd35 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.016481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.017121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.017399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.017669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] PATH_INFO: `/v3/services/image` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.019347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.020717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:34.031065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:34.032309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:34.033224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 510/997] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:34.038199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.051815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.054181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.054308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.054499 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.055279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] RBAC: Adding query filter params (interface=public, service_id=7e5f7b2321d64bd8be916985c3f956ac, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.055590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.056992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.063745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 488/998] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:33 2022] GET /identity/v3/endpoints?service_id=7e5f7b2321d64bd8be916985c3f956ac&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:34.069394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.161661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fce13-4043-417b-85b7-c463b17cdb89 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.201428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.201998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.202320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.202664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.203371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] RBAC: Adding query filter params (name=image) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.203682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.205482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.219891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 511/999] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:34.221191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.224127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.247329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.251042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f83b2-4fc6-49e1-994e-10bf2605a985 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.285232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a850c98-0a55-4605-af00-2f2bd61ddd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.285872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850c98-0a55-4605-af00-2f2bd61ddd7f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.286155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850c98-0a55-4605-af00-2f2bd61ddd7f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.286431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850c98-0a55-4605-af00-2f2bd61ddd7f None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.287038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a850c98-0a55-4605-af00-2f2bd61ddd7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.288390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a850c98-0a55-4605-af00-2f2bd61ddd7f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.295814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 489/1000] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:27:34.296998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ce58-6854-4986-af22-6359807af160 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.297283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ce58-6854-4986-af22-6359807af160 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.297560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066ce58-6854-4986-af22-6359807af160 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.298983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 490/1001] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:34.304698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.304982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.305270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.323935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:34.325228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:34.331537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bf8d2-8ef4-451b-a16d-3eb53c33e538 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.381588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.382262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.382545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.382818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.383472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] RBAC: Adding query filter params (type=image) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.383787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.385177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.390610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 512/1002] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:34.417208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 491/1003] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:34.688060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.758415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.794899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeee26-05d1-4421-a3a7-124c3531b386 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.830370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.831015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.831298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.831574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.832161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.833536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:34.843596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:34.844721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 03:27:34.845600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:34.849432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 513/1004] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:34.850752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:34.942794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:34.950014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf50932-41b1-44e0-941e-d9cde8ffc23a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:34.984511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:34.985124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:34.985402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:34.985673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:34.986332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:34.986633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:34.987992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:34.997819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 492/1005] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:34.999002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.102917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008413-96ba-40bd-b9dd-3ba775437318 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.131363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:35.137561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.138781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.139123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.139983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.140283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:35.140625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.142069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3031d93-4c3d-4bd1-984e-76f86442f0b3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.151199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 514/1006] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Aug 24 03:27:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:35.153549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:35.256927 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697b3fa-7b99-44f5-bf16-fd328fb981be None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:35.296465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ea26a-5ef9-4ad4-a1d8-808da2a2aafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:35.297236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea26a-5ef9-4ad4-a1d8-808da2a2aafd None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:35.297610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea26a-5ef9-4ad4-a1d8-808da2a2aafd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:35.298006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ea26a-5ef9-4ad4-a1d8-808da2a2aafd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:35.298765 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea26a-5ef9-4ad4-a1d8-808da2a2aafd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:35.300244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ea26a-5ef9-4ad4-a1d8-808da2a2aafd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:35.377585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 493/1007] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:36.247627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629348-b2f4-42f2-b858-ec6d4d92fea7 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.248150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629348-b2f4-42f2-b858-ec6d4d92fea7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.248150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67629348-b2f4-42f2-b858-ec6d4d92fea7 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.249747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 515/1008] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:36.255244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.255690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.255766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.274065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:36.275260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:36.289521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.318102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d2f8-5d56-4a97-958f-25545630e606 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.318444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d2f8-5d56-4a97-958f-25545630e606 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.318665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392d2f8-5d56-4a97-958f-25545630e606 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.320130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 516/1009] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:36.325162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.325453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.325737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.344862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:36.347168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:36.352561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 494/1010] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:36.422200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 517/1011] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:36.631106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.693322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.734632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d581a0-68b6-4b74-86c8-7fd12a1f255e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.774360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.774996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.775284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.775562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.776159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.777851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:36.787555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:36.788611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:36.789519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 495/1012] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:36.795061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:36.804367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7f0e7-fca8-4108-bd9d-24db2ee66976 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.806169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.830543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:36.842641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.843309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.843543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.843819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.844474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.845871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.899201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709188-0034-4701-bee6-947d5d37d4e2 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:36.932552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 518/1013] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:36 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:36.941793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:36.942511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:36.942860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:36.943149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:36.943751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:36.944064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:36.945514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:36.952263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 496/1014] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:36.958629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.073509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046e067-c52a-4cf3-9f59-f4d3da8b6948 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.114988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.115647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.116060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.116213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.116859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:37.117166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.118628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76535e8-fb27-40a1-80e4-dad17951d25b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.124173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 519/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Aug 24 03:27:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:37.130186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.203789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.239132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e752af50-a662-4cb4-ac4c-ee4b474a4bd2 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.279293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.279951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.280222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.280424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.281106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.282870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.323105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4ff03-7cf9-439b-bb04-99ebb6492322 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.323659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4ff03-7cf9-439b-bb04-99ebb6492322 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.323748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4ff03-7cf9-439b-bb04-99ebb6492322 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.325678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 520/1016] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:37.331126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.331409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.334699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.350388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:37.351593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:37.390084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 497/1017] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:37.409740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.442600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 521/1018] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:37.708691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.815080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0aeac-9d4b-4678-b25b-bbdc86da65f6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:37.839202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:37.850254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f35bf-be25-4a9d-b419-96009ab60a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:37.855595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f35bf-be25-4a9d-b419-96009ab60a4b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:37.855595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f35bf-be25-4a9d-b419-96009ab60a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:37.855595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f35bf-be25-4a9d-b419-96009ab60a4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:37.855595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f35bf-be25-4a9d-b419-96009ab60a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:37.855595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f35bf-be25-4a9d-b419-96009ab60a4b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:37.857867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 498/1019] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:37.862128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:37.970765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a4d6f-380f-46c3-bb28-6b8d49104288 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:38.005942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a12cd-c11f-4e13-aa12-7b131ca8f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:38.006565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a12cd-c11f-4e13-aa12-7b131ca8f022 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.006848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a12cd-c11f-4e13-aa12-7b131ca8f022 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.007121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a12cd-c11f-4e13-aa12-7b131ca8f022 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.007778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a12cd-c11f-4e13-aa12-7b131ca8f022 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:38.009269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a12cd-c11f-4e13-aa12-7b131ca8f022 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:38.110515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 522/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:27:37 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:38.881003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f22bc-06ab-4176-aafe-61b6cde39eee None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.881513 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f22bc-06ab-4176-aafe-61b6cde39eee None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.881591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f22bc-06ab-4176-aafe-61b6cde39eee None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.883072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 499/1021] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:38.888813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dacb97-a21d-40c6-8f83-c2a2a8fbe688 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:38.889329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dacb97-a21d-40c6-8f83-c2a2a8fbe688 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:38.889609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dacb97-a21d-40c6-8f83-c2a2a8fbe688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:38.907780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-42dacb97-a21d-40c6-8f83-c2a2a8fbe688 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:38.908972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-42dacb97-a21d-40c6-8f83-c2a2a8fbe688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:38.930232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:38.977402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 523/1022] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:39.253996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f22bc-06ab-4176-aafe-61b6cde39eee None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.360911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f22bc-06ab-4176-aafe-61b6cde39eee None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.390010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52f446-240d-4957-9ff8-f60c9a34bbe6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.390339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52f446-240d-4957-9ff8-f60c9a34bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.390696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52f446-240d-4957-9ff8-f60c9a34bbe6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.392478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 524/1023] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:39.397556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.397865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.398143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.407060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.407692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.407970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.408239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] PATH_INFO: `/v3/services/image` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.408820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.410200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.416871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:39.418079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:39.418904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.420073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:39.420994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 500/1024] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:39.425891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.495254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.500761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 525/1025] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:39.539939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e11e9-bd06-42ed-9ad9-953c54814b83 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.574337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.575527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.575802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.576065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.576690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.577049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.578433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.588957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 501/1026] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:39.590032 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.678573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.694923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78fb44-9733-4f1b-951a-13385a64f82f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.734023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.734634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.734959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.735229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.735860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.736159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.737516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.742873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 526/1027] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:39.748954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.772798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.866187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee4e05-dbf6-442a-8acd-e873e049bde5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.878259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456427f5-b223-4ae8-92cc-243c975c3bc8 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:39.889273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:39.905078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.905746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.906060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.906336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.907165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] RBAC: Adding query filter params (interface=public, service_id=3b7d505f198b44a49eeaa2a63780270d, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:39.907571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:39.908955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:39.915789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:39.916434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:39.916714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:39.916985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:39.919327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 502/1028] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/endpoints?service_id=3b7d505f198b44a49eeaa2a63780270d&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:39.920357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.928408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:39.933010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:39.934286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:39.935169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 527/1029] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:39.940161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:39.957119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.042794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b1d5-a9f4-430e-a14d-a3aee9953ac5 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.047889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e21a-84e3-4a71-862f-572edbf6b5ce None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.082669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c48e7-3ac4-4ec2-aae9-3196084a06bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.083594 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c48e7-3ac4-4ec2-aae9-3196084a06bf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.084128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c48e7-3ac4-4ec2-aae9-3196084a06bf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.084441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c48e7-3ac4-4ec2-aae9-3196084a06bf None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.085054 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c48e7-3ac4-4ec2-aae9-3196084a06bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.086469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c48e7-3ac4-4ec2-aae9-3196084a06bf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.088161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.088780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.089230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.089565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.090317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.096103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.096103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.096294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 503/1030] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/services => generated 1957 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:27:40.096294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295dfe-4cfa-4b64-aacc-003f4ab69f5a None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.096294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295dfe-4cfa-4b64-aacc-003f4ab69f5a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.096294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56295dfe-4cfa-4b64-aacc-003f4ab69f5a None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.096807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 504/1031] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:40.102767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.103078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.103334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.113706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 528/1032] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.116863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.123324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:40.124574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:40.177609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.202081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.206007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 505/1033] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:40.235375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719efde-642e-4c8f-9c5d-35c45b681690 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.280711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.281360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.281639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.281945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.293941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.295455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:40.310729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:40.312632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:40.314513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:40.314513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:40.314513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:40.314513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 529/1034] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:40.319584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.430851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f9a77-614f-49f9-a536-ac103d1ad68a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.474646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.480119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.480847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.481133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.481409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.482111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.482413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.483848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.497989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 506/1035] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.503439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.545552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.590095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce25c3a-0a06-437d-9c56-cf08d42d62c2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.614595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.618287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39e03d-1b74-427a-9d63-128228e78f71 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.626011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.626649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.626932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.627209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.628344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.629807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.631386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 530/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.637863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.657838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.658486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.658760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.659032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.666818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.668851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:40.681956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:40.682942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:40.683926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 507/1037] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:40.689661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.750986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abd7ed-6d07-422c-9c18-3ae22a856291 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.806039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.807011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.807489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.807964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.809130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.811626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.834095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:40.838533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96537ec2-df2e-457e-ac82-86a8e5bafb0e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:40.871738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:40.872350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:40.872677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:40.872907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:40.873632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:40.873967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:40.875392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:40.892540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 508/1038] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:40.898156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:40.914044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 531/1039] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:40 2022] POST /identity/v3/users => generated 285 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:27:41.012950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009edfc-782a-4783-b3aa-d6417a0d00b9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.053196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.053844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.056194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.056194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.082872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.142621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.144086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.250236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 509/1040] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:40 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:41.256125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.306337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.360200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bb72a-0b78-43e2-a979-a5ef63e1f7a3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.396100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.396749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.397033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.397306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.408428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.409967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:41.425872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:41.426900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:41.427837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:41.427837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:41.427837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:41.427837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 532/1041] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:41.434558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.501567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.545529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae635364-1ac0-4e19-9b4f-bf5305f608ec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.581974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.583074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.583074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.583074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.583689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:41.583992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.585361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.601266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 510/1042] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:41.602614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.707220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.711320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be121dd1-34b6-4ce3-9ff2-b54523dcff7f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.745440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.746111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.746408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.746675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.753562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.755036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:41.766768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:41.767736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:41.768674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:41.770086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 533/1043] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:41.773693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:41.878256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451cf57-1848-4753-a99c-e30091b2fa9b None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:41.894544 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:41.913394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:41.914039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:41.914327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:41.914601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:41.917578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:41.917578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:41.917578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014938f-5989-4e06-96f0-8a249664e10d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:41.929883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 511/1044] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:41.935787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.038392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829252-c3d9-4622-84b2-50e391242e70 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.066872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c928f-1dd8-49f2-aea8-d5e1d6daaa02 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.067272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c928f-1dd8-49f2-aea8-d5e1d6daaa02 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.067441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c928f-1dd8-49f2-aea8-d5e1d6daaa02 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.068827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 512/1045] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:42.073956 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.075156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.075270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.075432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.075538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.075713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.075808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.076453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] RBAC: Adding query filter params (role.id=82204103dcb44e28bf9cda182b99798b, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=afdf5eda0a634fe48781ef984f7bf496) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.076766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.078343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.085820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 534/1046] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:41 2022] GET /identity/v3/role_assignments?user.id=afdf5eda0a634fe48781ef984f7bf496&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=82204103dcb44e28bf9cda182b99798b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.095358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:42.096611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:42.174159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 513/1047] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:42.448635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.483511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.566767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2cee3-fbe6-45d2-96a2-8a1e2a536fea None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.602535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.603173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.603457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.603730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.604316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.606358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:42.615476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:42.616524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 03:27:42.617412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:42.624668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 535/1048] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:42.624808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.726266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7535a-ae1d-4fe8-a19b-6bb62e836b7d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.734276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.762013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.762632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.762912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.763191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.763890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.764221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.765558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8e70e-9746-4c00-bbca-3d14d0f45ad1 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.774008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 514/1049] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.776869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.867481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:42.879974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5b09-01d5-437e-ad36-e6833ec537c6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:42.919101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:42.919717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.919995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.920267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.920912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:42.921216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:42.922610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:42.924958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8732115-54b8-426a-a493-359e0cb6c8d7 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.925424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8732115-54b8-426a-a493-359e0cb6c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.925538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8732115-54b8-426a-a493-359e0cb6c8d7 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.926866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 515/1050] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:42.928919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 536/1051] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:42.932085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:42.932370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:42.932646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:42.934751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:42.951463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:42.952659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:43.020819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 516/1052] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:43.044205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722dffb4-bb40-4e97-a7a9-1b2e98e128d3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.080466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.081323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.081750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.082202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.083031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.084541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.171960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 537/1053] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:27:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:43.290599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.396463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.399522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdca1f-114c-414e-a346-2137c62e08b6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.441580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.442244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.442598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.442794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.457905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:43.462582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:43.463532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:43.466747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 517/1054] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:43.470306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.483047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.577922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39ddeb-8403-48e4-91d7-56882c24b9ec None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.612683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.613307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.613590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.613904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.614682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:43.614949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.616321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.630708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 538/1055] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:43.632154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.739333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41deea-feb8-4b62-bf0d-fe86dc1f3a15 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.775487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c048ad-a79c-4ea9-8c7d-f6ed8ea40e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.776471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c048ad-a79c-4ea9-8c7d-f6ed8ea40e07 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.777015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c048ad-a79c-4ea9-8c7d-f6ed8ea40e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.777539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c048ad-a79c-4ea9-8c7d-f6ed8ea40e07 None admin] PATH_INFO: `/v3/users/c0e92ae5827042c5a0ba36e07f7bd975` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.792291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c048ad-a79c-4ea9-8c7d-f6ed8ea40e07 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e92ae5827042c5a0ba36e07f7bd975)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:43.794529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c048ad-a79c-4ea9-8c7d-f6ed8ea40e07 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:43.801397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 518/1056] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/users/c0e92ae5827042c5a0ba36e07f7bd975 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:43.802411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:43.875954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:43.906201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31e03e-974d-4370-8988-2959d9abd635 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:43.941373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:43.942007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.942287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.942557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:43.998654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38121-8e92-485f-b120-5cde17551ef4 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:43.999183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38121-8e92-485f-b120-5cde17551ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:43.999350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b38121-8e92-485f-b120-5cde17551ef4 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.000762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 519/1057] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:44.005803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.006082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.006357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.012224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.014518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.023762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:44.024943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:44.035224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.097820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 520/1058] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:44.105300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.137215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 539/1059] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:44.143007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.253037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00ef3d-ea8e-47ec-b153-42523773ee2a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.288173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.288807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.289090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.289361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.290541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] RBAC: Authorizing `identity:get_project(project_id=4f470ff8c9e4411e935b094fcf3034e6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.291999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.294564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 521/1060] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:44.300893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.379314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.395148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.407177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6881d8-d174-4d0d-83de-47f7ec5cbd24 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.443893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.444506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.444790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.445065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.445809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=4f470ff8c9e4411e935b094fcf3034e6, user.id=c0e92ae5827042c5a0ba36e07f7bd975) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.446132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.447550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.457186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 540/1061] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/role_assignments?user.id=c0e92ae5827042c5a0ba36e07f7bd975&scope.project.id=4f470ff8c9e4411e935b094fcf3034e6&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:44.504545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342da44-3a57-4b97-80d5-3dc4c07d216e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.543642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.544291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.544568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.544833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.556303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:44.561099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.566079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:44.566962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 522/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:44.568921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.608352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.675652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696b232-c83a-489e-a9ba-7c1cec6b9d13 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.710551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.711167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.711450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.711725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.712386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:44.712691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.714088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.728638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 541/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:44.729895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:44.803333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:44.837623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5793a-2c1f-42c1-a112-e6a03f799c46 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:44.873226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:44.873982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:44.874266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:44.874537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:44.885073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:44.886557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:44.902881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:44.903907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:44.904866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:44.904866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:44.904866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:44.904866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 523/1064] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:44.910960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.006168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.013019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917c8ff-a442-4601-b86e-076b14fab752 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.048622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.049236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.049519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.049816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.050469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:45.050776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.052142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc177a1-4142-4f18-a84b-307009867893 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.069029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 542/1065] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:45.070312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.141252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0b43-db7e-4631-8f3c-43f9058edbf1 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.141582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0b43-db7e-4631-8f3c-43f9058edbf1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.141836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e0b43-db7e-4631-8f3c-43f9058edbf1 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.143391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 543/1066] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:45.148391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.148675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.148954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.167062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:45.168821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:45.182290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf62b95-ddd9-4538-b53e-e1049609b809 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.208654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.219985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.220624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.220904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.221180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.229674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.231702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.249005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 544/1067] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:45.249178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:45.250168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:45.251203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 524/1068] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:45.251831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.338606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.354264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59930b-025e-49f0-ac78-766ba6bac335 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.391416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.392037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.392318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.392592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.393328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:45.393635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.395116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.418056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 545/1069] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:45.419068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.509108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.534706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685de0d-e8bb-495a-b301-ce642fbb7e1c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.573033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.574019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.574521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.574962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.586421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.588075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:45.604144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:45.605253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:45.607009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:45.607009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:45.607009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:45.607009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 525/1070] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:45.610979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.624738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0cc5b-e4e5-4440-92ca-d9e39b0aa0de None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.654461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.665730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.666377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.666659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.667088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.681871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.723475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c676-d757-4ba7-8dc1-0b9f269f944d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.737929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.739382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.758127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.758742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.759027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.759307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.759956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:45.760264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.761693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.774802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 526/1071] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:45.780157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.859453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 546/1072] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:27:45.861114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:45.888055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.894439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d7de7-77f5-4e97-98cb-3a16d34fda18 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.909822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:45.935583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:45.936232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:45.936509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:45.936776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:45.945699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:45.947867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:45.965259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:45.967093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:45.968018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:45.968455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a206d8-eb69-43d3-8e15-f5c7b392822c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:45.968532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 527/1073] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:45.972361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.006827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:46.007907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.007907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.007907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.020747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:46.022102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:46.037907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:46.038944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:46.039858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:46.039858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:46.039858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:46.039858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 547/1074] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:46.044926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.086730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb2cb3-5844-4de7-b088-262fa90dcacd None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:46.125703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:46.126263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.126543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.126813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.127507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:46.127810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:46.129242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:46.141996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 528/1075] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:46.145737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:46.147639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.154038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f57dc-7483-41af-8ee7-0551ba268183 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:46.166622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:46.190794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:46.191414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.191695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.191967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.192664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:46.192983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:46.194386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9debd-ab3d-4be8-a372-8b9eced192f9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:46.217797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 548/1076] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:46.259933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb38ac2-6baa-4d09-b041-614bf21d34ec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:46.302043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:46.302735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.303014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.303285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/afdf5eda0a634fe48781ef984f7bf496/roles/82204103dcb44e28bf9cda182b99798b` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.305582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=afdf5eda0a634fe48781ef984f7bf496, role_id=82204103dcb44e28bf9cda182b99798b)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:46.307134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:46.368411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8df3-2867-4679-b12a-d6e05177a022 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.368701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8df3-2867-4679-b12a-d6e05177a022 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.368981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea8df3-2867-4679-b12a-d6e05177a022 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.370374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 549/1077] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:46.376052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.376279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.376593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.396577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:46.397808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:46.398472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 529/1078] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:46 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/afdf5eda0a634fe48781ef984f7bf496/roles/82204103dcb44e28bf9cda182b99798b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:27:46.491426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 550/1079] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:46.759213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:46.836948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:46.859831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2531d-bda1-4062-bde7-1a09c8d5d49a None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:46.893928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:46.894567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:46.894844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:46.895114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:46.905623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:46.910771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:46.911871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:46.912869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 530/1080] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:46.918360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.007276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.024346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44338a1-f189-49c6-a42b-de19e6301dfd None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.057381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.058103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.058377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.058675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.059342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:47.059644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.061011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.069130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 551/1081] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:47.074933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.210574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb265231-a6c0-4bc1-8a9c-cc4d20c5cc84 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.243969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.244592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.244868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.245134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] PATH_INFO: `/v3/users/c0e92ae5827042c5a0ba36e07f7bd975` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.246297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e92ae5827042c5a0ba36e07f7bd975)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.247713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.249293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 531/1082] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/users/c0e92ae5827042c5a0ba36e07f7bd975 => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:47.257796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.357994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25922b2-6331-49e1-be26-49328a0a9d67 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.397531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77135bd-5a53-4d7a-ba3a-67ca0df880a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.398286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77135bd-5a53-4d7a-ba3a-67ca0df880a2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.398599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77135bd-5a53-4d7a-ba3a-67ca0df880a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.398866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77135bd-5a53-4d7a-ba3a-67ca0df880a2 None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.399981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77135bd-5a53-4d7a-ba3a-67ca0df880a2 None admin] RBAC: Authorizing `identity:get_project(project_id=4f470ff8c9e4411e935b094fcf3034e6)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.401403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77135bd-5a53-4d7a-ba3a-67ca0df880a2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.403706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 552/1083] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:47 2022] GET /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:47.409624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:47.413393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:47.514200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bad220-c4d7-42f8-bf3f-3ca6a084e984 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:47.547000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe298-4e87-4544-91cb-50ee5b0efdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:47.547660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe298-4e87-4544-91cb-50ee5b0efdba None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:47.547938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe298-4e87-4544-91cb-50ee5b0efdba None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:47.548208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe298-4e87-4544-91cb-50ee5b0efdba None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6/users/c0e92ae5827042c5a0ba36e07f7bd975/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:47.550105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe298-4e87-4544-91cb-50ee5b0efdba None admin] RBAC: Authorizing `identity:create_grant(project_id=4f470ff8c9e4411e935b094fcf3034e6, user_id=c0e92ae5827042c5a0ba36e07f7bd975, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:47.551529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe298-4e87-4544-91cb-50ee5b0efdba None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:47.656562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 532/1084] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:47 2022] PUT /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6/users/c0e92ae5827042c5a0ba36e07f7bd975/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:27:48.317633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fcf5-f72d-4da6-88c3-26565cb0f057 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.318186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fcf5-f72d-4da6-88c3-26565cb0f057 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.318186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8fcf5-f72d-4da6-88c3-26565cb0f057 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.319546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 553/1085] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:48.325403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.325825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.326193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.354151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:48.355390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:48.414354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.422240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 533/1086] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:48.692825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8fcf5-f72d-4da6-88c3-26565cb0f057 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.712818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:48.800242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8fcf5-f72d-4da6-88c3-26565cb0f057 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.833420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.834087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.834446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.834716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.845381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:48.850126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:48.851181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:48.852066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 554/1087] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:48.858250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:48.960434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097ed4c-2bd4-4912-8882-2fc9e4d64ba5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:48.994637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:48.995243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:48.995525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:48.995826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:48.996496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:48.996803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:48.998211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.006403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 534/1088] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:27:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:49.012815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.091879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.115292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d7517-29a1-49f1-8dcb-6859da4bb755 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.149192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.149855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.150138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.150409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.161389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.162539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:49.177519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:49.178589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:49.179527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:49.179527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:49.179527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:49.179527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 555/1089] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:49.184860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.245104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.290417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c8d55-878f-4a96-9fef-dc2bfe5961ac None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.323718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.324877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.325159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.325431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.326106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:49.326410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.327775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.340060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 535/1090] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:49.345699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.445089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47549f-b5db-4184-8f87-0ba075ffe75e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.475673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.483655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.484292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.484576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.484870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.493452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.495085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-8b8ff3ad-3494-4b6a-921d-aa97bc814e69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:27:49.507886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:49.509284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:49.510526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 556/1091] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:27:49.515331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.589708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d24208-7964-4e4a-bc9b-293b95a580c8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.590158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d24208-7964-4e4a-bc9b-293b95a580c8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.590505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d24208-7964-4e4a-bc9b-293b95a580c8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.591942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 557/1092] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:27:49.596938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.597227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.597506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.615789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:49.617291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:49.621434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff42685-aa54-4a95-bcec-09c8bef4b8d4 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.639385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.657186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.657870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.658147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.658416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.659144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:49.659454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.661006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.679559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 536/1093] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:49.686642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.689159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 558/1094] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:27:49.784879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034ede0-b8bc-4583-9240-598ea095d5dd None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:49.820579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:49.821249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:49.821589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:49.821832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:49.864674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:49.889369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:49.891367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:49.969591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:49.988437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 537/1095] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:49.994220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.068426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.068762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878747e3-24d3-42fa-9f16-9b7dadcb8c34 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.087065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.093083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f8b05-8ae0-41dd-a160-9854ee5db088 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.106009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.106654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.106936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.107209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.117381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:27:50.122156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:50.123202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:27:50.124102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 559/1096] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:50.127727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.128439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.128767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.128988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.129499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.139448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.140910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:27:50.157004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:50.158168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:27:50.159080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:27:50.159080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:27:50.159080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:50.159080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 538/1097] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:50.163706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.233691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afbba7-8319-4ff2-9aff-7095ac83d71a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.263126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a53c-c521-40cd-89e7-ae74a2c5b269 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.268229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.268836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.269113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.269382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.270079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:50.270382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.271741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.279875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 560/1098] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:50.285815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.288084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.297478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.298158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.298406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.298679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.304762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:50.304762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.304762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.313244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 539/1099] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:50.318903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.327567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.393577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1027e37-dc03-4894-9f58-adffc6ded32e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.427186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.427807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.428088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.428322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b8c9e-3142-412e-8b02-4e41d6bb672d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.428769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] PATH_INFO: `/v3/users/c0e92ae5827042c5a0ba36e07f7bd975` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.429579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=c0e92ae5827042c5a0ba36e07f7bd975)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.431047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.432613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 561/1100] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/users/c0e92ae5827042c5a0ba36e07f7bd975 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:50.439168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.464049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.464684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.464966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.465237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.472183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.473635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:27:50.485325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:27:50.486473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:27:50.487754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 540/1101] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:27:50.492313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.545697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.548547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa91c5e-adc4-45d6-a599-dcd5371c4ad9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.557401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.582097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.582628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.582909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.583183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.600095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81616e52-a4d4-42d5-a6ba-0ac157f51b1d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.637206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.637833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.638119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.638390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.639076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:50.639385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.640808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.652677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 541/1102] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:50.653731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.655209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.658754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.758092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 562/1103] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:50.764811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:50.766342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca186007-30f3-437e-975b-be1154fd4bec None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.773941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.774736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:50.802685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.803291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.803567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.803836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.804570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] RBAC: Adding query filter params (role.id=82204103dcb44e28bf9cda182b99798b, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=afdf5eda0a634fe48781ef984f7bf496) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:50.804875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.806349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.812866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 542/1104] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/role_assignments?user.id=afdf5eda0a634fe48781ef984f7bf496&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=82204103dcb44e28bf9cda182b99798b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:50.875026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fce2a-443d-468e-aa73-558bb4b6704e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:50.911351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c2596-c302-4a07-b96c-1988a3994cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:50.911995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2596-c302-4a07-b96c-1988a3994cea None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:50.912269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2596-c302-4a07-b96c-1988a3994cea None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:50.912535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c2596-c302-4a07-b96c-1988a3994cea None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:50.913668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c2596-c302-4a07-b96c-1988a3994cea None admin] RBAC: Authorizing `identity:get_project(project_id=4f470ff8c9e4411e935b094fcf3034e6)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:50.915141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c2596-c302-4a07-b96c-1988a3994cea None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:50.916837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 563/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:27:50.923918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:51.032282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356908e-3e9a-4035-b8ab-e8509de723c7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:51.067873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:51.068477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:51.068749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:51.069017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:51.069740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=4f470ff8c9e4411e935b094fcf3034e6, user.id=c0e92ae5827042c5a0ba36e07f7bd975) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:51.070078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:51.071585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7ee19-5e67-4d62-b1be-d26955840c7d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:51.077710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 543/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:50 2022] GET /identity/v3/role_assignments?user.id=c0e92ae5827042c5a0ba36e07f7bd975&scope.project.id=4f470ff8c9e4411e935b094fcf3034e6&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.018109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0c007-7a55-48f5-8724-3bdcce487af9 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.018715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0c007-7a55-48f5-8724-3bdcce487af9 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.018715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0c007-7a55-48f5-8724-3bdcce487af9 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.019995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 564/1107] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:53.025452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.025909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.026021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.044725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:53.045929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:53.110690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.115912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 544/1108] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:53.383588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0c007-7a55-48f5-8724-3bdcce487af9 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.460799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:53.484791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0c007-7a55-48f5-8724-3bdcce487af9 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.518920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ee680-bf3f-40a1-937a-5c2ec1437d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.519543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee680-bf3f-40a1-937a-5c2ec1437d37 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.519825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee680-bf3f-40a1-937a-5c2ec1437d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.520099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ee680-bf3f-40a1-937a-5c2ec1437d37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.521215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ee680-bf3f-40a1-937a-5c2ec1437d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.522668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ee680-bf3f-40a1-937a-5c2ec1437d37 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.524242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 565/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:27:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:53.530592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:53.624991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc241-4abd-4138-829a-c72fb39c6617 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:53.658241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d29f4-2fc2-47ac-a078-d0a3c69f286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:53.658780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d29f4-2fc2-47ac-a078-d0a3c69f286e None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:53.659058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d29f4-2fc2-47ac-a078-d0a3c69f286e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:53.659329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d29f4-2fc2-47ac-a078-d0a3c69f286e None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:53.659964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d29f4-2fc2-47ac-a078-d0a3c69f286e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:53.661380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d29f4-2fc2-47ac-a078-d0a3c69f286e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:53.735076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 545/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:27:53 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:27:55.669459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504dd4d-0fae-41db-b85d-cbc981d92104 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.670031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504dd4d-0fae-41db-b85d-cbc981d92104 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.670031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504dd4d-0fae-41db-b85d-cbc981d92104 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.671367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 566/1111] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:55.676649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:55.677061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:55.677206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:55.695075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:55.696272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:55.710768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:55.762933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 546/1112] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:56.032823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504dd4d-0fae-41db-b85d-cbc981d92104 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.133110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504dd4d-0fae-41db-b85d-cbc981d92104 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.166350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.167008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.167286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.167561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] PATH_INFO: `/v3/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.168956 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] RBAC: Authorizing `identity:get_role(role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.170349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.171680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 567/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.179821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.282507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a45fd6-4eb3-4c24-9315-9337476aad93 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.322873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.323463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.323741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.324013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] PATH_INFO: `/v3/users/7041f13518454eeaaa8361e81451cf55` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.338302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] RBAC: Authorizing `identity:get_user(user_id=7041f13518454eeaaa8361e81451cf55)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.340298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.342004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 547/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/users/7041f13518454eeaaa8361e81451cf55 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.348020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.367212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.454513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1eeed-43c7-4af3-b096-7b76d7377256 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.489643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.490284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.490561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.490832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.586027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.587403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.602052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.686066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 568/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:27:56.691856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.703555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.791460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbff49-4f26-48fc-8fa1-2d6e1a02f38e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.825138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0e751-cb04-4e0c-b20b-f5bc177df7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.825759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0e751-cb04-4e0c-b20b-f5bc177df7fc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.826057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0e751-cb04-4e0c-b20b-f5bc177df7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.826323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0e751-cb04-4e0c-b20b-f5bc177df7fc None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.827422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0e751-cb04-4e0c-b20b-f5bc177df7fc None admin] RBAC: Authorizing `identity:get_project(project_id=4f470ff8c9e4411e935b094fcf3034e6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.829087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0e751-cb04-4e0c-b20b-f5bc177df7fc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.830743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 548/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:56.837012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:56.936398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238493-bd12-4180-860e-5ed412652a02 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:56.949543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:56.970278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:56.970887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:56.971164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:56.971437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:56.972179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] RBAC: Adding query filter params (role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=4f470ff8c9e4411e935b094fcf3034e6, user.id=7041f13518454eeaaa8361e81451cf55) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:27:56.972470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:56.973913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08e1bc-d832-4a8f-902a-97253eb22dc9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:56.979436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 569/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:27:56 2022] GET /identity/v3/role_assignments?user.id=7041f13518454eeaaa8361e81451cf55&scope.project.id=4f470ff8c9e4411e935b094fcf3034e6&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:58.855495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa5bc-bc56-4e60-90db-a3b9a9202d75 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.856158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa5bc-bc56-4e60-90db-a3b9a9202d75 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.856158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa5bc-bc56-4e60-90db-a3b9a9202d75 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.857357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 549/1118] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:27:58.862583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:58.862966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:58.863141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:58.881401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:27:58.882628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:27:58.947250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 570/1119] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:27:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:27:59.214573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa5bc-bc56-4e60-90db-a3b9a9202d75 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.293049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.316304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa5bc-bc56-4e60-90db-a3b9a9202d75 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.350624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.351248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.351529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.351802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] PATH_INFO: `/v3/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.353187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] RBAC: Authorizing `identity:get_role(role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.355220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.356548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 550/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.362518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.459942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5ebc7-f176-41e2-ba77-d5e310b1b1ac None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.468068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:27:59.493893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.494525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.494835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.495113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] PATH_INFO: `/v3/users/7041f13518454eeaaa8361e81451cf55` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.496258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=7041f13518454eeaaa8361e81451cf55)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.497687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.499295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 571/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/users/7041f13518454eeaaa8361e81451cf55 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.505291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.602004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288f087-0841-4c72-aa27-13cd4b733fb9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.634750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df102bd-55c9-438b-8110-4e9bdc3eac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.635918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df102bd-55c9-438b-8110-4e9bdc3eac58 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.636194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df102bd-55c9-438b-8110-4e9bdc3eac58 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.636464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df102bd-55c9-438b-8110-4e9bdc3eac58 None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.637570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df102bd-55c9-438b-8110-4e9bdc3eac58 None admin] RBAC: Authorizing `identity:get_project(project_id=4f470ff8c9e4411e935b094fcf3034e6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.639032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df102bd-55c9-438b-8110-4e9bdc3eac58 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.640657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 551/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:27:59 2022] GET /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:27:59.646678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:27:59.743353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2990-2348-424d-aca4-f0e6b5917ff4 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:27:59.777309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a25bb8-ee4c-4e4f-9dc8-f26b7cea5186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:27:59.777982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a25bb8-ee4c-4e4f-9dc8-f26b7cea5186 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:27:59.778260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a25bb8-ee4c-4e4f-9dc8-f26b7cea5186 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:27:59.778528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a25bb8-ee4c-4e4f-9dc8-f26b7cea5186 None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6/users/7041f13518454eeaaa8361e81451cf55/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:27:59.780779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a25bb8-ee4c-4e4f-9dc8-f26b7cea5186 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f470ff8c9e4411e935b094fcf3034e6, user_id=7041f13518454eeaaa8361e81451cf55, role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:27:59.782244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a25bb8-ee4c-4e4f-9dc8-f26b7cea5186 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:27:59.854043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 572/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:27:59 2022] PUT /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6/users/7041f13518454eeaaa8361e81451cf55/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:01.733063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639423-3e31-4d34-9642-b846282d5e8c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.733578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639423-3e31-4d34-9642-b846282d5e8c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:01.733578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58639423-3e31-4d34-9642-b846282d5e8c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:01.734901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 552/1124] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:01.741013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:01.741456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:01.741554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:01.759296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:01.760995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:01.787348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:01.829744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 573/1125] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:02.098800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639423-3e31-4d34-9642-b846282d5e8c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.113531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.200386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58639423-3e31-4d34-9642-b846282d5e8c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.235002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.235664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.235953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.236232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] PATH_INFO: `/v3/roles/ac093a2bc3cf4ea4869c077a98799c11` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.238347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] RBAC: Authorizing `identity:get_role(role_id=ac093a2bc3cf4ea4869c077a98799c11)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.239724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.241066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 553/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/roles/ac093a2bc3cf4ea4869c077a98799c11 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:02.250429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.347607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7ea1f-4153-4915-b4ce-705dfd54cd11 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.382368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.382914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.383191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.383461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] PATH_INFO: `/v3/users/7041f13518454eeaaa8361e81451cf55` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.384592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] RBAC: Authorizing `identity:get_user(user_id=7041f13518454eeaaa8361e81451cf55)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.386628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.388211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 574/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/users/7041f13518454eeaaa8361e81451cf55 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:02.394212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.483954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.503069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281df9-7618-4175-a0c8-0db06f66c935 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.537526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.538218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.538501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.538771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.605361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.606845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.684936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.704355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 554/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:02.710359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.741425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:02.809862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815f24b-1273-44aa-b851-463df256a4ed None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.843133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f4f49-d7f8-4aa5-9069-0a683a997974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.843760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4f49-d7f8-4aa5-9069-0a683a997974 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.844042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4f49-d7f8-4aa5-9069-0a683a997974 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.844317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f4f49-d7f8-4aa5-9069-0a683a997974 None admin] PATH_INFO: `/v3/projects/4f470ff8c9e4411e935b094fcf3034e6` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.845442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f4f49-d7f8-4aa5-9069-0a683a997974 None admin] RBAC: Authorizing `identity:get_project(project_id=4f470ff8c9e4411e935b094fcf3034e6)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.846901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f4f49-d7f8-4aa5-9069-0a683a997974 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.848542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 575/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/projects/4f470ff8c9e4411e935b094fcf3034e6 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:02.855341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:02.950537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999a381-e2fa-4de7-9e09-da52a9e80a0d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:02.985293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:02.985919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:02.986199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:02.986470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:02.987198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] RBAC: Adding query filter params (role.id=ac093a2bc3cf4ea4869c077a98799c11, scope.project.id=4f470ff8c9e4411e935b094fcf3034e6, user.id=7041f13518454eeaaa8361e81451cf55) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:02.987504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:02.988919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f6e52-fb46-4db9-8164-3b385e904126 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:02.994665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 555/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:02 2022] GET /identity/v3/role_assignments?user.id=7041f13518454eeaaa8361e81451cf55&scope.project.id=4f470ff8c9e4411e935b094fcf3034e6&role.id=ac093a2bc3cf4ea4869c077a98799c11 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:04.930157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687f74-bee7-4fc7-9328-7e2c9fb2e0c2 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.930732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687f74-bee7-4fc7-9328-7e2c9fb2e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.930881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687f74-bee7-4fc7-9328-7e2c9fb2e0c2 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.932880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 576/1131] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:04.939892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:04.940389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:04.940539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:04.958416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:04.959611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:04.998955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:05.024682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 556/1132] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:05.296546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687f74-bee7-4fc7-9328-7e2c9fb2e0c2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.395088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:05.399015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687f74-bee7-4fc7-9328-7e2c9fb2e0c2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.432557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a29344-f792-4ca3-be50-c6766954e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.433179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a29344-f792-4ca3-be50-c6766954e5fd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.433459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a29344-f792-4ca3-be50-c6766954e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.433735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a29344-f792-4ca3-be50-c6766954e5fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.434882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a29344-f792-4ca3-be50-c6766954e5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.436310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a29344-f792-4ca3-be50-c6766954e5fd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.437901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 577/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:05.444009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:05.542892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed3b0f-4940-4b61-908f-da79c34d4094 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:05.575730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16b3a-4d1c-4b96-ab02-e143f91b85e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:05.576269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16b3a-4d1c-4b96-ab02-e143f91b85e2 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:05.576549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16b3a-4d1c-4b96-ab02-e143f91b85e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:05.576820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16b3a-4d1c-4b96-ab02-e143f91b85e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:05.577725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16b3a-4d1c-4b96-ab02-e143f91b85e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:05.579171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16b3a-4d1c-4b96-ab02-e143f91b85e2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:05.683491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 557/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:05 2022] POST /identity/v3/projects => generated 311 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:28:07.637835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d565d6-be19-478a-824b-120e5ebe5ef8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.638354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d565d6-be19-478a-824b-120e5ebe5ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.638443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d565d6-be19-478a-824b-120e5ebe5ef8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.639733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 578/1135] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:07.644870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:07.645308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:07.645405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:07.663567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:07.664747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:07.683967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:07.731595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 558/1136] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:08.006164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d565d6-be19-478a-824b-120e5ebe5ef8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.110037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d565d6-be19-478a-824b-120e5ebe5ef8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.144904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a2a4b-88cf-4f16-a211-89e3a093f2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.145541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2a4b-88cf-4f16-a211-89e3a093f2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.145882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2a4b-88cf-4f16-a211-89e3a093f2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.146118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2a4b-88cf-4f16-a211-89e3a093f2f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.147238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a2a4b-88cf-4f16-a211-89e3a093f2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.148663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a2a4b-88cf-4f16-a211-89e3a093f2f2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.150373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 579/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:28:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:08.156606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:08.254774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8477ec7-144e-46d0-8a90-c756bbfb3776 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:08.287832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62796951-d8de-49f8-a83f-65d5fe1da909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:08.288428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796951-d8de-49f8-a83f-65d5fe1da909 None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:08.288705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796951-d8de-49f8-a83f-65d5fe1da909 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:08.288987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62796951-d8de-49f8-a83f-65d5fe1da909 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:08.289614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62796951-d8de-49f8-a83f-65d5fe1da909 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:08.291711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62796951-d8de-49f8-a83f-65d5fe1da909 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:08.402857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 559/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:08 2022] POST /identity/v3/users => generated 286 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:28:10.371276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ddbd9-885c-4970-a37d-444e7acb77f0 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.371877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ddbd9-885c-4970-a37d-444e7acb77f0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.371877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ddbd9-885c-4970-a37d-444e7acb77f0 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.373155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 580/1139] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:10.378603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88858113-2905-402d-922a-e1aa4614413e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.379049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88858113-2905-402d-922a-e1aa4614413e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.379150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88858113-2905-402d-922a-e1aa4614413e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.397388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-88858113-2905-402d-922a-e1aa4614413e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:10.398636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-88858113-2905-402d-922a-e1aa4614413e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:10.405694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.465579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 560/1140] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:10.735450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ddbd9-885c-4970-a37d-444e7acb77f0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.771294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:10.836593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ddbd9-885c-4970-a37d-444e7acb77f0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:10.869572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:10.870216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:10.870495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:10.870767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:10.880480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:10.885149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:10.886478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:28:10.887639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 581/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:10.892260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88858113-2905-402d-922a-e1aa4614413e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:10.987629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88858113-2905-402d-922a-e1aa4614413e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.021056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.021658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.021970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.022244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.022913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:11.023218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.024580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.033100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 561/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.039216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.177850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.183355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cbc39-3f0f-4a10-8d11-bfd5b3d5015b None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.215874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.239995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.239995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.239995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] PATH_INFO: `/v3/users/dc2be46cc478468ba8811256e356af69` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.239995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] RBAC: Authorizing `identity:get_user(user_id=dc2be46cc478468ba8811256e356af69)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.239995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.239995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 582/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/users/dc2be46cc478468ba8811256e356af69 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.240497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.243286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.343613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5479-e985-466f-87e2-d0590ade4bc9 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.376599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.377202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.377483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.377787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.443592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.445047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.448211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.542236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 562/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:28:11.548053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.674044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab56ff-ac8c-42c1-88c0-f69db3927dea None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.707975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45350ac0-18ba-472f-be18-655a97232dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.710736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350ac0-18ba-472f-be18-655a97232dee None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.710736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350ac0-18ba-472f-be18-655a97232dee None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.710736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350ac0-18ba-472f-be18-655a97232dee None admin] PATH_INFO: `/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.710736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45350ac0-18ba-472f-be18-655a97232dee None admin] RBAC: Authorizing `identity:get_project(project_id=12bb3f41c0ff40d6b338704ac3140c6d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.711796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45350ac0-18ba-472f-be18-655a97232dee None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.714011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 583/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:11.720566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:11.817461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09929-b5c6-4828-b4c4-df2e68dc9dbd None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:11.819733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:11.851166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:11.851792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:11.852081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:11.852559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:11.853536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=12bb3f41c0ff40d6b338704ac3140c6d, user.id=dc2be46cc478468ba8811256e356af69) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:11.854321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:11.855800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d918-6aca-42b8-85a3-631c5eedd78e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:11.861188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 563/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:11 2022] GET /identity/v3/role_assignments?user.id=dc2be46cc478468ba8811256e356af69&scope.project.id=12bb3f41c0ff40d6b338704ac3140c6d&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:13.755115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd67cd-f303-4f67-85cf-c9e6fa3a5194 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.755638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd67cd-f303-4f67-85cf-c9e6fa3a5194 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.755638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd67cd-f303-4f67-85cf-c9e6fa3a5194 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.756925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 584/1147] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:13.762652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:13.763083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:13.763188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:13.781392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:13.782606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:13.846908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 564/1148] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:14.113576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd67cd-f303-4f67-85cf-c9e6fa3a5194 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.138957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.214633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd67cd-f303-4f67-85cf-c9e6fa3a5194 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.248274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.248908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.249190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.249465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.260647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:14.265402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:14.266577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:28:14.267674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 585/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:14.272592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.370652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.374384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b9eb5-6e73-4533-b3f8-99b3d62724d5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.408391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.408990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.409269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.409537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.410231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:14.410529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.411881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.420336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 565/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:14.426211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.514635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:14.531939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be86ff-d4a7-49b5-83b6-a59336bebb0d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.566520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.567146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.567425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.567699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] PATH_INFO: `/v3/users/dc2be46cc478468ba8811256e356af69` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.568824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] RBAC: Authorizing `identity:get_user(user_id=dc2be46cc478468ba8811256e356af69)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.570285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.571984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 586/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/users/dc2be46cc478468ba8811256e356af69 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:14.578189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.675769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233eee07-6441-4cd4-98cd-8f58734180bf None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.709356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6627d-b152-4cd2-a4a7-d64765309ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.710015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6627d-b152-4cd2-a4a7-d64765309ded None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.710300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6627d-b152-4cd2-a4a7-d64765309ded None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.710574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6627d-b152-4cd2-a4a7-d64765309ded None admin] PATH_INFO: `/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.711690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6627d-b152-4cd2-a4a7-d64765309ded None admin] RBAC: Authorizing `identity:get_project(project_id=12bb3f41c0ff40d6b338704ac3140c6d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.713143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6627d-b152-4cd2-a4a7-d64765309ded None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.714809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 566/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:14 2022] GET /identity/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:14.720843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:14.818659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0179b-ac4b-4ce2-bcab-7f298f270a94 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:14.852397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3b3c9b-6e5f-4b37-bbe0-ce91f3d1c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:14.853616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b3c9b-6e5f-4b37-bbe0-ce91f3d1c5f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:14.853930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b3c9b-6e5f-4b37-bbe0-ce91f3d1c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:14.854202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b3c9b-6e5f-4b37-bbe0-ce91f3d1c5f9 None admin] PATH_INFO: `/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d/users/dc2be46cc478468ba8811256e356af69/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:14.856078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b3c9b-6e5f-4b37-bbe0-ce91f3d1c5f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=12bb3f41c0ff40d6b338704ac3140c6d, user_id=dc2be46cc478468ba8811256e356af69, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:14.857497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3b3c9b-6e5f-4b37-bbe0-ce91f3d1c5f9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:14.944529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 587/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:14 2022] PUT /identity/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d/users/dc2be46cc478468ba8811256e356af69/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:16.817980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ecce-7776-4538-8265-dddb03cb028c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:16.818500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ecce-7776-4538-8265-dddb03cb028c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:16.818589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ecce-7776-4538-8265-dddb03cb028c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:16.819879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 567/1154] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:16.825862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:16.826309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:16.826690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:16.844275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:16.845451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:16.848157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:16.910333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 588/1155] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:17.177339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ecce-7776-4538-8265-dddb03cb028c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.205781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.279084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ecce-7776-4538-8265-dddb03cb028c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.311837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.312459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.312741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.313014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.323290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:17.328209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:17.329329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:28:17.330310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 568/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:17.335506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.432403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f66750-0a36-4c5e-aed2-a6e0581fa774 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.466892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.467498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.467777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.468050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.468710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:17.469015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:17.470417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:17.478526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 589/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:17.484256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.570866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.583064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc068c-068b-459b-a067-ccaf4527cf5c None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.615653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.616276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.616555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.616825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] PATH_INFO: `/v3/users/dc2be46cc478468ba8811256e356af69` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.618015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] RBAC: Authorizing `identity:get_user(user_id=dc2be46cc478468ba8811256e356af69)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:17.619485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:17.621037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 569/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/users/dc2be46cc478468ba8811256e356af69 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:17.627126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:17.630031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.732006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d59b2-0e78-49e1-8567-0077d3dbafc5 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:17.765371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:17.766001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:17.766284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:17.766560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:17.831926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:17.833377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:17.835234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:17.928530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 590/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:17.935016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.032163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0028848-f495-4efe-b75b-cde1c66c5589 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.064901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a8b8c-a3b2-466b-955f-863bc4dfa7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.065521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a8b8c-a3b2-466b-955f-863bc4dfa7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.065826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a8b8c-a3b2-466b-955f-863bc4dfa7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.066106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a8b8c-a3b2-466b-955f-863bc4dfa7c3 None admin] PATH_INFO: `/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.067232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a8b8c-a3b2-466b-955f-863bc4dfa7c3 None admin] RBAC: Authorizing `identity:get_project(project_id=12bb3f41c0ff40d6b338704ac3140c6d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.068655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a8b8c-a3b2-466b-955f-863bc4dfa7c3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.070316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 570/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:17 2022] GET /identity/v3/projects/12bb3f41c0ff40d6b338704ac3140c6d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:18.077409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:18.174675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09cc3c-03d0-4886-a8b7-97b2d74c0ae3 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:18.176219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:18.209240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:18.209883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:18.210164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:18.210438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:18.211156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=12bb3f41c0ff40d6b338704ac3140c6d, user.id=dc2be46cc478468ba8811256e356af69) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:18.211464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:18.212914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3477d-3bb3-423c-aaad-fc9814011fd9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:18.218658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 591/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:18 2022] GET /identity/v3/role_assignments?user.id=dc2be46cc478468ba8811256e356af69&scope.project.id=12bb3f41c0ff40d6b338704ac3140c6d&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:20.140161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80856-533f-4e2d-916a-2586d31ea3e2 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.140728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80856-533f-4e2d-916a-2586d31ea3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.140728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80856-533f-4e2d-916a-2586d31ea3e2 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.142078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 571/1162] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:20.147201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.147575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.147752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.166580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:20.167763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:20.232432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 592/1163] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:20.502935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80856-533f-4e2d-916a-2586d31ea3e2 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:20.527877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:20.621447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80856-533f-4e2d-916a-2586d31ea3e2 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:20.655146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:20.655751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.656036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.656308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.726384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:20.728242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:20.752154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:20.824694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 572/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 03:28:20.830926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:20.922672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:20.928472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5ec85-4f7e-4257-8945-155357871cab None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:20.962681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:20.963306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:20.963587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:20.963864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:20.970503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:20.971939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-3f8171a5-ce38-49ae-b1a6-df99571d299b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:20.984757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:20.986016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:28:20.987112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 593/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:28:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:20.991806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:21.089819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c282d19-e029-4e18-883f-aa24adbb2b54 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:21.113341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:21.123845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:21.124455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:21.124732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:21.125001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:21.125649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:21.125976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:21.127332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d5003-de76-4ced-8402-5864d4b7febb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:21.135230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 573/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Aug 24 03:28:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:23.054058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f5bd-81ee-46c2-ac25-109b35f3a8e0 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:23.054656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f5bd-81ee-46c2-ac25-109b35f3a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:23.054656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706f5bd-81ee-46c2-ac25-109b35f3a8e0 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:23.056460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 594/1167] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:23.061783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548530-e67f-4f28-8fc5-d9be991aa6e0 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:23.062237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548530-e67f-4f28-8fc5-d9be991aa6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:23.062337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a548530-e67f-4f28-8fc5-d9be991aa6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:23.081831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7a548530-e67f-4f28-8fc5-d9be991aa6e0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:23.083041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7a548530-e67f-4f28-8fc5-d9be991aa6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:23.148431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 574/1168] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:28:23.413847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706f5bd-81ee-46c2-ac25-109b35f3a8e0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:23.514065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706f5bd-81ee-46c2-ac25-109b35f3a8e0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:23.546771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bcacf-a872-420e-9f6b-60436b49ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:23.547370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bcacf-a872-420e-9f6b-60436b49ae2b None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:23.547644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bcacf-a872-420e-9f6b-60436b49ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:23.547909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bcacf-a872-420e-9f6b-60436b49ae2b None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:23.548599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bcacf-a872-420e-9f6b-60436b49ae2b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:23.549984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bcacf-a872-420e-9f6b-60436b49ae2b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:23.636243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 595/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Wed Aug 24 03:28:23 2022] POST /identity/v3/domains => generated 267 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:25.559601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e68e-4419-4abe-a749-f945d663f0e5 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:25.560138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e68e-4419-4abe-a749-f945d663f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:25.560138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31e68e-4419-4abe-a749-f945d663f0e5 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:25.561522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 575/1170] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:25.566701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:25.567136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:25.567243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:25.585744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:25.587087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:25.597502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:25.654721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 596/1171] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:25.922547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31e68e-4419-4abe-a749-f945d663f0e5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:26.024305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31e68e-4419-4abe-a749-f945d663f0e5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:26.041736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:26.057976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cf81c-cf3f-4b5f-b089-5e8b7e0ee730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:26.059959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf81c-cf3f-4b5f-b089-5e8b7e0ee730 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:26.059959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf81c-cf3f-4b5f-b089-5e8b7e0ee730 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:26.059959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cf81c-cf3f-4b5f-b089-5e8b7e0ee730 None admin] PATH_INFO: `/v3/domains/fac61021cd2849439ad735d91b553c1d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:26.069734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cf81c-cf3f-4b5f-b089-5e8b7e0ee730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fac61021cd2849439ad735d91b553c1d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:26.071246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221cf81c-cf3f-4b5f-b089-5e8b7e0ee730 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:26.072823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 576/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 24 03:28:25 2022] GET /identity/v3/domains/fac61021cd2849439ad735d91b553c1d => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:26.079113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:26.176965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2c46d-47fd-4334-b141-bb056c4c9093 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:26.209934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b26ff-56ec-4e1f-a461-d78e3e6efb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:26.210544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b26ff-56ec-4e1f-a461-d78e3e6efb1f None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:26.210825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b26ff-56ec-4e1f-a461-d78e3e6efb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:26.211098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b26ff-56ec-4e1f-a461-d78e3e6efb1f None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:26.212290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b26ff-56ec-4e1f-a461-d78e3e6efb1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:26.213720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b26ff-56ec-4e1f-a461-d78e3e6efb1f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:26.292683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:26.299745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 597/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:28:26 2022] POST /identity/v3/projects => generated 361 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:28.379339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06144c41-fc87-44b2-9a60-da66d3a3a5a5 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.379908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06144c41-fc87-44b2-9a60-da66d3a3a5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.379908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06144c41-fc87-44b2-9a60-da66d3a3a5a5 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.381234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 577/1174] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:28.386867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.387324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.387428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.405708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:28.406929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:28.473517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 598/1175] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:28.756011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06144c41-fc87-44b2-9a60-da66d3a3a5a5 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.857834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06144c41-fc87-44b2-9a60-da66d3a3a5a5 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:28.890975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a96b90-5ccc-42e8-b67d-40eb8219cb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:28.891608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96b90-5ccc-42e8-b67d-40eb8219cb99 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:28.891890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96b90-5ccc-42e8-b67d-40eb8219cb99 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:28.892166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a96b90-5ccc-42e8-b67d-40eb8219cb99 None admin] PATH_INFO: `/v3/domains/fac61021cd2849439ad735d91b553c1d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:28.893287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a96b90-5ccc-42e8-b67d-40eb8219cb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fac61021cd2849439ad735d91b553c1d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:28.894753 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a96b90-5ccc-42e8-b67d-40eb8219cb99 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:28.896319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 578/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Aug 24 03:28:28 2022] GET /identity/v3/domains/fac61021cd2849439ad735d91b553c1d => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:28.902577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:28.998620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ef7f5-0272-4b5b-9941-2e02ecf455f0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:29.029076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:29.036562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4fc5-a97a-480a-a819-09f6d8fdd663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:29.043393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4fc5-a97a-480a-a819-09f6d8fdd663 None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:29.043393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4fc5-a97a-480a-a819-09f6d8fdd663 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:29.043393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4fc5-a97a-480a-a819-09f6d8fdd663 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:29.043393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4fc5-a97a-480a-a819-09f6d8fdd663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:29.043393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4fc5-a97a-480a-a819-09f6d8fdd663 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:29.155060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 599/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:28:28 2022] POST /identity/v3/users => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:28:31.155420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978babf-9a73-4ad4-9ddf-0ca9b0010a28 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.155958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978babf-9a73-4ad4-9ddf-0ca9b0010a28 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.155958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978babf-9a73-4ad4-9ddf-0ca9b0010a28 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.157299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 579/1178] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:31.166158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.166654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.166761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.189530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:31.190769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:31.268573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 600/1179] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:31.538668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978babf-9a73-4ad4-9ddf-0ca9b0010a28 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.586252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.640270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978babf-9a73-4ad4-9ddf-0ca9b0010a28 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.674087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.674719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.674999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.675271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.686242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:31.691136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:31.693906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:28:31.695126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 580/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:31.698320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.798847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db308a8c-2390-467e-8364-8609a4299b38 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.812851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.831629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.832233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.832509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.832855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.833437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:31.833737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.835122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.843201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 601/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:31.849160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:31.946071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798162fb-5a2d-4739-a05f-603092aa2233 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:31.953166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:31.979225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:31.979869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:31.980145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:31.980412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] PATH_INFO: `/v3/users/84d89f499f90460698d78cade5228395` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:31.994000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] RBAC: Authorizing `identity:get_user(user_id=84d89f499f90460698d78cade5228395)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:31.995483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:31.997058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 581/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:31 2022] GET /identity/v3/users/84d89f499f90460698d78cade5228395 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:32.003030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:32.105908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837a398-4521-4f14-af3c-edd8afdef33e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:32.139876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:32.140483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:32.140763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:32.141037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:32.259211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:32.283265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:32.284713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:32.388427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 602/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:32.394506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:32.495971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fea1a5-548a-4df7-8649-580b054bd688 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:32.528658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db48db2-2322-40ee-9955-d7403b309772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:32.529200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db48db2-2322-40ee-9955-d7403b309772 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:32.529479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db48db2-2322-40ee-9955-d7403b309772 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:32.529750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db48db2-2322-40ee-9955-d7403b309772 None admin] PATH_INFO: `/v3/projects/54031935c2a74d35991b47ea583a54a5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:32.530889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db48db2-2322-40ee-9955-d7403b309772 None admin] RBAC: Authorizing `identity:get_project(project_id=54031935c2a74d35991b47ea583a54a5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:32.532314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db48db2-2322-40ee-9955-d7403b309772 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:32.533974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 582/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:32 2022] GET /identity/v3/projects/54031935c2a74d35991b47ea583a54a5 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:32.540673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:32.615376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:32.643262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b5c5e-d032-426f-8ec6-ef4a20923615 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:32.676804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:32.677398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:32.677732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:32.677969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:32.678678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=54031935c2a74d35991b47ea583a54a5, user.id=84d89f499f90460698d78cade5228395) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:32.678980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:32.680989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdb1a8-4380-4817-a768-b0869b737e4f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:32.686256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 603/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:32 2022] GET /identity/v3/role_assignments?user.id=84d89f499f90460698d78cade5228395&scope.project.id=54031935c2a74d35991b47ea583a54a5&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:34.608820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529dbc-c5dc-4f3c-9873-c8503e80df99 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:34.612473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529dbc-c5dc-4f3c-9873-c8503e80df99 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:34.612780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7529dbc-c5dc-4f3c-9873-c8503e80df99 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:34.614285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 583/1186] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:34.619735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:34.620177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:34.620272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:34.639932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:34.641121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:34.710089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 604/1187] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:35.019154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7529dbc-c5dc-4f3c-9873-c8503e80df99 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.050291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:35.124338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7529dbc-c5dc-4f3c-9873-c8503e80df99 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.158356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.158984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.159265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.159539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.169478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:35.174148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:35.175288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:28:35.176244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 584/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:28:35.181928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.250035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:35.279841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e8fe1-542e-4485-959e-207788a8f189 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.313565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.314194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.314472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.314743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.315403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:35.315704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:35.317114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.325848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 605/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:35.331914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.423977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:35.437812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aea259-ba97-45a4-a3ae-104055a9deb0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.472602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.473232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.473520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.473894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] PATH_INFO: `/v3/users/84d89f499f90460698d78cade5228395` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.474945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] RBAC: Authorizing `identity:get_user(user_id=84d89f499f90460698d78cade5228395)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:35.476964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.478587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 585/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/users/84d89f499f90460698d78cade5228395 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:35.484340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.582255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f14c-a7c0-430b-a959-83162ee24fa9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.610705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:35.615523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417be9d-618e-4bf5-85ae-fa5093d8b8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.616151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417be9d-618e-4bf5-85ae-fa5093d8b8ba None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.616457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417be9d-618e-4bf5-85ae-fa5093d8b8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.617248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417be9d-618e-4bf5-85ae-fa5093d8b8ba None admin] PATH_INFO: `/v3/projects/54031935c2a74d35991b47ea583a54a5` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.618386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417be9d-618e-4bf5-85ae-fa5093d8b8ba None admin] RBAC: Authorizing `identity:get_project(project_id=54031935c2a74d35991b47ea583a54a5)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:35.619810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417be9d-618e-4bf5-85ae-fa5093d8b8ba None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.621436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 606/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:35 2022] GET /identity/v3/projects/54031935c2a74d35991b47ea583a54a5 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:35.627566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:35.725069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa06f6c-f3d2-45f4-811f-c8bece3c57b0 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:35.765739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088dd88-ba5e-4df4-8129-b05445350719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:35.766439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088dd88-ba5e-4df4-8129-b05445350719 None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:35.766717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088dd88-ba5e-4df4-8129-b05445350719 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:35.767109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088dd88-ba5e-4df4-8129-b05445350719 None admin] PATH_INFO: `/v3/projects/54031935c2a74d35991b47ea583a54a5/users/84d89f499f90460698d78cade5228395/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:35.769043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088dd88-ba5e-4df4-8129-b05445350719 None admin] RBAC: Authorizing `identity:create_grant(project_id=54031935c2a74d35991b47ea583a54a5, user_id=84d89f499f90460698d78cade5228395, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:35.770524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088dd88-ba5e-4df4-8129-b05445350719 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:35.857895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 586/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:28:35 2022] PUT /identity/v3/projects/54031935c2a74d35991b47ea583a54a5/users/84d89f499f90460698d78cade5228395/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:28:37.750129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbef38-7261-426d-b30f-fb4c9e3f856b None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:37.750655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbef38-7261-426d-b30f-fb4c9e3f856b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:37.750655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbef38-7261-426d-b30f-fb4c9e3f856b None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:37.751946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 607/1193] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:28:37.757702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:37.758114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:37.758283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:37.776455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:28:37.777641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:28:37.791572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:37.842793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 587/1194] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:28:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:28:38.115087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbef38-7261-426d-b30f-fb4c9e3f856b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.216617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbef38-7261-426d-b30f-fb4c9e3f856b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.249550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:38.250197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.250479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.250752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.260658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:28:38.265356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:28:38.266395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:28:38.267287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 608/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:28:38.273073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.369959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8140d-73b8-488a-95d4-a54055c55c63 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.404128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:38.404735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.405011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.405283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.405978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:38.406281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:38.407642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:38.415452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 588/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:38.421314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.481287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:38.521422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec9785-4b59-4853-ac7d-3d52414e9999 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.555353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:38.555975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.556254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.556526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] PATH_INFO: `/v3/users/84d89f499f90460698d78cade5228395` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.557640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] RBAC: Authorizing `identity:get_user(user_id=84d89f499f90460698d78cade5228395)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:38.559085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:38.560658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 609/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/users/84d89f499f90460698d78cade5228395 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:38.566825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.583108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:38.666720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e2173-036b-4e3e-bb82-29b32786817d None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.699083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:38.699936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:38.700214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:38.700482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:38.767362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:38.768812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:38.781872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:38.864403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 589/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:28:38.871036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:38.968625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97838c-faf2-4f26-8e35-2b5b6a36882e None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:38.994304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:39.001842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd9724-e0c1-4842-b257-5f053a8a7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:39.002473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9724-e0c1-4842-b257-5f053a8a7e37 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:39.009937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9724-e0c1-4842-b257-5f053a8a7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:39.009937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd9724-e0c1-4842-b257-5f053a8a7e37 None admin] PATH_INFO: `/v3/projects/54031935c2a74d35991b47ea583a54a5` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:39.009937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd9724-e0c1-4842-b257-5f053a8a7e37 None admin] RBAC: Authorizing `identity:get_project(project_id=54031935c2a74d35991b47ea583a54a5)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:39.009937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd9724-e0c1-4842-b257-5f053a8a7e37 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:39.009937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 610/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Aug 24 03:28:38 2022] GET /identity/v3/projects/54031935c2a74d35991b47ea583a54a5 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:39.013929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:28:39.113251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfdc5a-c2e6-4522-8ad1-704e47b38674 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:28:39.126762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:39.147572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:28:39.148178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:28:39.148454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:28:39.148725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:28:39.149449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=54031935c2a74d35991b47ea583a54a5, user.id=84d89f499f90460698d78cade5228395) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:28:39.149757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:28:39.151204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743fdad-9468-46c1-b2bb-626bfcdefccc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:28:39.156856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 590/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:28:39 2022] GET /identity/v3/role_assignments?user.id=84d89f499f90460698d78cade5228395&scope.project.id=54031935c2a74d35991b47ea583a54a5&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:28:49.028234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:28:49.159345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=12 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:54.849267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf3c8-1b37-4a8c-ad96-156cb961ce49 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:54.849907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf3c8-1b37-4a8c-ad96-156cb961ce49 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:54.849907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7baf3c8-1b37-4a8c-ad96-156cb961ce49 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:54.851218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 611/1201] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:54.856719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:54.857193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:54.857294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:54.875747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:54.876936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:54.945098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 591/1202] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:55.220100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf3c8-1b37-4a8c-ad96-156cb961ce49 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:55.324055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7baf3c8-1b37-4a8c-ad96-156cb961ce49 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:55.360787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:55.361430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:55.361708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:55.362006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:55.372557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:55.374046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:55.390671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:55.391964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:55.393309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:55.393309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:55.393309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:29:55.393309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 612/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:55.398353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:55.500257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a7420-aa61-4fb4-ab5e-1ecab85077aa None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:55.529213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:55.535592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:55.536203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:55.536484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:55.536755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:55.537401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:55.537702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:55.539105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf8a31-9882-4e00-a040-1d309abddab3 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:55.550341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 592/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:55.556371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:55.611117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:55.659031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60642675-95eb-474e-a4ee-868a145d37e2 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:55.692048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca5135-252e-4258-8286-7bb261c6bc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:55.692926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5135-252e-4258-8286-7bb261c6bc4e None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:55.693205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5135-252e-4258-8286-7bb261c6bc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:55.693480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5135-252e-4258-8286-7bb261c6bc4e None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:55.694155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5135-252e-4258-8286-7bb261c6bc4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:55.695586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5135-252e-4258-8286-7bb261c6bc4e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:55.874201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 613/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Aug 24 03:29:55 2022] POST /identity/v3/users => generated 251 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:29:57.836536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d300d9-52b9-4a99-a9f0-c0a7592685bf None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.837092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d300d9-52b9-4a99-a9f0-c0a7592685bf None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.837092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d300d9-52b9-4a99-a9f0-c0a7592685bf None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.838506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 593/1206] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:29:57.844177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:57.844691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:57.844803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:57.863311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:29:57.864655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:29:57.936852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 614/1207] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:29:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:29:58.210135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d300d9-52b9-4a99-a9f0-c0a7592685bf None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.310056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d300d9-52b9-4a99-a9f0-c0a7592685bf None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.343119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.343746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.344029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.344301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.355484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:29:58.365705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:58.366879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:29:58.367769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 594/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:58.368520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.407197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:58.467249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28661c93-f37b-431c-82f8-4ae92518e385 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.504793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.505415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.505698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.506003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.506674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:58.506982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.508356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.516263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 615/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:58.522042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.571792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:58.621258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ee373-361a-4682-89c8-6b922d504b85 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.653529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.654192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.654472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.654745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.666008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.667445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:58.681706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:58.682900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:58.683949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:58.683949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:58.683949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:29:58.683949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 595/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:58.688798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.786637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:58.789653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111fda-0c93-4b13-9f32-be9284af362a None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.823078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.823682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.823963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.824238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.824876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:58.825183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.826566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.837437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 616/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:58.843183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:58.944810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef157d1-b980-4055-b98e-68a12bf47a9f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:58.946371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:58.976850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:58.977470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:58.977746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:58.978075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] PATH_INFO: `/v3/users/placement` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:58.985204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:58.986666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:29:58.997864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:58.999041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:29:59.000257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 596/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:59.005531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:59.110843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8b8bb-b94d-4e85-bc27-3923964d542c None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:59.146421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:59.157357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:59.157357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:59.157357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:59.157357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:59.157357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:59.157357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:59.167066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 617/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 24 03:29:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:59.174253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:59.277882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd081d-40dd-45e9-8448-e71bd22fd1ad None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:59.312133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:59.312770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:59.313030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:59.313304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:59.342768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:59.380294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:59.381670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:59.478975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 597/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:29:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:29:59.485056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:59.504925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:59.583367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad09ba6-bb38-4da6-8bb4-7aaf90026366 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:59.618121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:59.618749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:59.619031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:59.619304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:59.629409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:59.630945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:29:59.645533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:59.646734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:29:59.647790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:29:59.647790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:29:59.647790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:29:59.647790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 618/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:59.652554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:59.727164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:59.769375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911030a0-3ec1-47b3-9268-9bd3a637dfbe None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:59.807705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:59.808327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:59.808631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:59.808901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:59.809546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:29:59.809957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:59.811403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:59.823105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 598/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:29:59.828865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:29:59.899856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:29:59.930877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2bac-ba18-48cf-98a5-a939c760c044 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:29:59.963960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:29:59.964589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:29:59.964867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:29:59.965140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:29:59.972177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:29:59.973606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:29:59.984935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:29:59.986065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:29:59.987014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 619/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:29:59.992068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:00.092625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75935c0-8d39-4e90-858b-4f3ecbfeaefe None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:00.116456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:00.128558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:00.130856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:00.130856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:00.130856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:00.130856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:00.130856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:00.132299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64e232-0c46-4382-ae07-c7597c363e35 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:00.146607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 599/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:00.152851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:00.251601 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a42b6-309d-4da8-bf03-844ceb9b6467 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:00.279606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:00.285259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:00.285870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:00.286151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:00.286422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:00.287138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=411e88250df044a993d8eb39d988390b) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:00.287439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:00.288921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b28d5-3f52-4104-abf7-305c67bfa0bc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:00.294232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 620/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:00 2022] GET /identity/v3/role_assignments?user.id=411e88250df044a993d8eb39d988390b&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:02.180005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02895bf-b604-4463-9ce0-de0244b811b4 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.180571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02895bf-b604-4463-9ce0-de0244b811b4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.180571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02895bf-b604-4463-9ce0-de0244b811b4 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.181954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 600/1220] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:02.187129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.187533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.187679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.205789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:02.207547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:02.274493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 621/1221] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:02.539758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02895bf-b604-4463-9ce0-de0244b811b4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.643112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02895bf-b604-4463-9ce0-de0244b811b4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.676937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.677555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.677864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.678139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.688189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:02.693755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:02.694907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:02.696150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 601/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:02.701026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.796884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5df07-a9f5-4f85-b89e-fa4a97c46946 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.822892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:02.833213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.833852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.834132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.834401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.835065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:02.835365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.836717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:02.844278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 622/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:02.850225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:02.894741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:02.949890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00398a-2307-4d1a-9401-c06475d5fd50 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:02.983063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:02.983693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:02.983976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:02.984248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:02.994782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:02.996333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:03.012422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:03.013615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:03.014776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:03.014776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:03.014776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:03.014776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 602/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:03.019424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:03.117333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65082f3-257e-4e28-b066-268050099d99 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:03.150294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:03.155617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:03.155617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:03.155617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:03.155617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:03.155617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:03.155617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.166209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 623/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:03.172043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:03.265874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:03.272412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93575f31-b91d-472d-ac63-e483e672a0e6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:03.305755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:03.344615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:03.345261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:03.346476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:03.348135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 603/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:03.348775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:03.381337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:03.433944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e023fe-bb54-45a1-976a-496124fc4298 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:03.467864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:03.468472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:03.468751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:03.470058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:03.470058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:03.470226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:03.471697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.489331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 624/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:03.495059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:03.593984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eccfd5-9dbb-4e25-80fc-d25c5e93d9bb None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:03.628670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:03.629331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:03.629618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:03.629926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:03.640445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:03.641935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:03.656633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:03.657881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:03.658796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:03.658796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:03.658796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:03.658796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 604/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:03.664384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:03.769655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cec8e-5065-44fe-93d4-6b8badb0fefe None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:03.772053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:03.807684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:03.808297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:03.808582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:03.808861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:03.809545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:03.809909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:03.811291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.823393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 625/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:03.829343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:03.839403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:03.928564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997df74-b350-430a-b3b8-8f7100289639 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:03.962503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:03.963130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:03.968196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:03.968196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:03.970192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:03.971637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:03.982486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:03.983549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:03.989521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 605/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:03.990279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:04.092017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a716250-9f31-4cba-bd3a-8ee3951eb790 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:04.126074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:04.126743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:04.127020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:04.127320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:04.127983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:04.128339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:04.130332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cebc03-cbae-4884-b6f0-69c2b9809d7e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:04.142356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 626/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:30:04.148523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:04.214063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:04.248282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725c24c-514d-4a12-bcc7-d5eae73c1b82 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:04.281508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f53d5-652e-4118-87fa-6f38f8b0b04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:04.282228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f53d5-652e-4118-87fa-6f38f8b0b04b None admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:04.282484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f53d5-652e-4118-87fa-6f38f8b0b04b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:04.282756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f53d5-652e-4118-87fa-6f38f8b0b04b None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/411e88250df044a993d8eb39d988390b/roles/c11fd1501aed40c08689d2e812cf3497` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:04.297899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f53d5-652e-4118-87fa-6f38f8b0b04b None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=411e88250df044a993d8eb39d988390b, role_id=c11fd1501aed40c08689d2e812cf3497)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:04.299351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f53d5-652e-4118-87fa-6f38f8b0b04b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:04.439280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 606/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:30:04 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/411e88250df044a993d8eb39d988390b/roles/c11fd1501aed40c08689d2e812cf3497 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:30:06.345737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db062b3-2925-4f8d-a478-2de43cd33213 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.346315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db062b3-2925-4f8d-a478-2de43cd33213 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.346315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db062b3-2925-4f8d-a478-2de43cd33213 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.347651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 627/1233] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:06.353014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.353456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.353572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.372440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:06.372440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:06.442494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 607/1234] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:06.709132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db062b3-2925-4f8d-a478-2de43cd33213 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.734878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.811676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db062b3-2925-4f8d-a478-2de43cd33213 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:06.845873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:06.849316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:06.849316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:06.849316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:06.857619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:06.862989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:06.864488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:06.866257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 628/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:06.870541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:06.917279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:06.968616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a979034-c076-4187-ad8f-5a74933d63cb None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.003090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.003690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.003967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.004238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.004894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:07.005194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.006579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:07.014495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 608/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Aug 24 03:30:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:07.020295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:07.108135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:07.124484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d022-524a-4b05-978b-9614cbcb72fa None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.158692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.159901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.160183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.160500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.171148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.172619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:07.187496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:07.188641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:07.189943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:07.189943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:07.189943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:07.189943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 629/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:07.195119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:07.303444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef2f4c-6069-4995-af0f-7ad00aa6e1fe None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.312635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:07.337929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.338536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.338817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.339090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.339731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:07.340034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.341390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:07.353418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 609/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:07.364194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:07.463485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6367bf7-6b84-4ea1-a7b1-7d7cd43827fc None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.497631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.498288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.498564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.498834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.501550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:07.507303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.515617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:07.532260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:07.539416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:07.540648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 630/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:07.542714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:07.648845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7a52d-55e0-401e-937a-272a55fa290e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.681925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.682534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.682813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.683384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.683796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:07.684102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.685523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:07.703009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 610/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:07.709725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:07.828073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c85d1-69e0-4e48-a2c0-0412e8b2de55 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:07.864576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:07.865257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:07.865536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:07.865832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:07.943870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:07.950372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:07.951816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:08.048681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 631/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:08.055272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:08.100646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:08.177030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853dc1b-2346-4aa0-a4c8-7e4890074655 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:08.218831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:08.219820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:08.220190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:08.220467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:08.234052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:08.235764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:08.251769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:08.252954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:08.255146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:08.255146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:08.255146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:08.255146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 611/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 03:30:08.259381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:08.370344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:08.379469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16395-1b78-4878-ae5b-a030921cba26 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:08.420047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:08.420782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:08.421131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:08.421469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:08.422716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:08.423203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:08.425571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:08.438086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 632/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:08.443892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:08.525510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:08.558799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950adb7-c3d7-4625-880e-0ea8a6cc1957 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:08.596992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:08.597629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:08.597943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:08.598220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:08.605945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:08.606973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:08.619534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:08.620969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:08.622051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 612/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:08.626663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:08.730284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427da10-1a3b-4764-ab32-2a498695e08d None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:08.765341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:08.765994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:08.766272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:08.766539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:08.767223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:08.767526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:08.769479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4af3a-bedc-4679-a92a-35f54ce5ef67 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:08.781537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 633/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:08.788443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:08.889510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14039a35-0b8b-4b84-9a2a-f377ed83130f None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:08.924319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:08.924940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:08.925256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:08.925529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:08.926290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] RBAC: Adding query filter params (role.id=c11fd1501aed40c08689d2e812cf3497, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=411e88250df044a993d8eb39d988390b) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:08.926599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:08.928027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3b239-fa29-41b0-8480-75415192e981 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:08.934099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 613/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:08 2022] GET /identity/v3/role_assignments?user.id=411e88250df044a993d8eb39d988390b&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=c11fd1501aed40c08689d2e812cf3497 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:10.928140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c26e-fd68-4c19-8389-26db3a7606ef None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.928751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c26e-fd68-4c19-8389-26db3a7606ef None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.928751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c26e-fd68-4c19-8389-26db3a7606ef None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.930062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 634/1247] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:10.935248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:10.935655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:10.935799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:10.943071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:10.955391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:10.956737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:11.023104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 614/1248] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:11.298547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c26e-fd68-4c19-8389-26db3a7606ef None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:11.320329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:11.402996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c26e-fd68-4c19-8389-26db3a7606ef None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:11.436840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:11.437459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:11.437738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:11.438042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:11.449067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:11.455315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:11.456507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:11.457376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 635/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:11.461214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:11.560440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3414d-6be9-48f7-bb2a-8bf7de146b7d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:11.588492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:11.593018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:11.593620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:11.593925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:11.594195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:11.594856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:11.595225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:11.597035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:11.604829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 615/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:11.610624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:11.690171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:11.712620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcbdeb-3130-480f-aa21-bc14912623d0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:11.745888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:11.746523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:11.746863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:11.747082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:11.757538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:11.759013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:11.773734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:11.774940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:11.776344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:11.776344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:11.776344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:11.776344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 636/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:11.781004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:11.882137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d138b-3109-433a-b69d-d46fcc4762a2 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:11.917104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:11.917707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:11.918014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:11.918282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:11.918918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:11.919215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:11.920577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:11.932574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 616/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:30:11.938496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:12.039015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e39166-0eca-4249-87fc-c9a4eeca445f None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:12.065586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:12.074034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:12.074667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:12.074947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:12.075223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:12.083250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:12.084685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:12.095944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:12.097118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:12.098695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 637/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:12.103025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:12.159845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:12.203254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58308f9-2344-4d08-9296-25dee8528273 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:12.236245 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:12.236918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:12.237200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:12.237474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:12.238230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:12.238535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:12.239953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:12.257330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 617/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:12.263208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:12.364949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ffeac-16c7-466e-a7ef-f8f0f53ea103 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:12.399812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:12.400490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:12.400773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:12.401047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:12.456705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:12.468782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:12.470301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:12.568239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 638/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:12.574339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:12.672477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea548fc8-1eef-4975-b936-a823dfb4a636 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:12.685772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:12.706890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:12.707455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:12.707737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:12.708036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:12.717799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:12.719271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:12.733914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:12.735087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:12.736258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:12.736258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:12.736258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:12.736258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 618/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:12.741430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:12.831142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:12.842952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83883d67-885f-44b7-ba2e-7dedc32333cd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:12.877203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:12.877940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:12.878298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:12.878509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:12.879137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:12.879439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:12.880812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:12.891713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 639/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:12.897587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:12.997580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7243fc48-e88a-4ec0-884d-51e45c35820e None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:13.030615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:13.031242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.031524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.031797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.038861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:13.040351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:13.052190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:13.053372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:13.054522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 619/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:13.059288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:13.158325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c3f2f-8831-4108-b88b-811140208ffd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:13.191501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:13.192106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.192385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.192657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.193337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:13.193640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:13.195090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea6edf-5401-48b7-bef9-352a6218469b None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:13.207367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 640/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:13.213610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:13.240168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:13.311292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074e63a-4202-4d57-96f2-bb3c641a4fcc None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:13.344059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:13.350807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:13.350807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:13.350807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:13.350807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=411e88250df044a993d8eb39d988390b) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:13.350807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:13.350807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac070f-de55-45c8-9549-7d0a788b1aee None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:13.353783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 620/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:13 2022] GET /identity/v3/role_assignments?user.id=411e88250df044a993d8eb39d988390b&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=bde35209edd64a3187d196af53f70e5d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:15.251823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbcef-249f-45f7-9027-3f8f157ed039 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.252354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbcef-249f-45f7-9027-3f8f157ed039 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.252354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbcef-249f-45f7-9027-3f8f157ed039 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.254257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 641/1261] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:15.259350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.259790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.259986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.278670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:15.279894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:15.352343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 621/1262] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:30:15.625080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbcef-249f-45f7-9027-3f8f157ed039 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.645044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:15.753928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbcef-249f-45f7-9027-3f8f157ed039 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.788164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.788803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.789233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.789456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.800375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:15.805264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:15.806313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:15.807276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 642/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:15.812592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:15.831241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:15.913592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16018b-0ce8-4e41-ae78-24b5307acb28 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:15.948154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:15.948761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:15.949044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:15.949316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:15.950009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:15.950315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:15.951689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:15.960476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 622/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:15.966526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.044792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:16.081344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a96f5d-6c83-4d66-a224-8771ef010715 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.119197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.119859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.120136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.120405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.130967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.132407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:16.150099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:16.151323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:16.152637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:16.152637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:16.152637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:16.152637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 643/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:16.157030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.243328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:16.256308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9e55-5ff3-4b5c-9cda-b90eb8ac3e24 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.289515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.290175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.290409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.290679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.291311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:16.291611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.292969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.304725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 623/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:16.311005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.415420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0f0c1-96f4-4045-87f9-d1aa954e5fb6 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.435661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:16.449884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.450513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.450800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.451076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.460100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.461566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:16.473125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:16.474285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:16.475358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 644/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:16.480168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.581262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e0644-12cb-487d-90c1-506304691aa6 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.614953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.615559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.622562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.622562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.622562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:16.622562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.622562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.628257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:16.636411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 624/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:16.642214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.740924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d143e7-9df2-48f1-979f-ac37727e5787 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.774903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.775541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.775820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.776116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.787093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.788526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:16.802421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:16.803618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:16.804792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:16.804792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:16.804792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:16.804792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 645/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:16.809725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:16.911350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8388763-0cb8-475e-8e74-d1e15b574afe None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:16.945857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:16.946471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:16.946752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:16.947022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:16.947667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:16.947964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:16.949341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:16.961232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 625/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:16.969625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:17.001455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:17.069332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4593df-5e5f-45aa-b7ad-426d2f9c57d9 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:17.103511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:17.104140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:17.104422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:17.104754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:17.111492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:17.113448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:17.124495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:17.125600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:17.126760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 646/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:17.132189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:17.198967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:17.230876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e5520-370d-4e13-a861-6c9996c31d08 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:17.263490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:17.264090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:17.264365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:17.264631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:17.265324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:17.265616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:17.267069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b92a1-0272-4a59-a2aa-0e1037352543 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:17.278684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 626/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:30:17.285433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:17.381066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:17.391910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e04b21-f4a9-4182-bd8f-e93a841222eb None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:17.425462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ade9-a7eb-46f7-8ad5-9c1c903c699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:17.426146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ade9-a7eb-46f7-8ad5-9c1c903c699e None admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:17.426425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ade9-a7eb-46f7-8ad5-9c1c903c699e None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:17.426698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ade9-a7eb-46f7-8ad5-9c1c903c699e None admin] PATH_INFO: `/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/411e88250df044a993d8eb39d988390b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:17.428629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ade9-a7eb-46f7-8ad5-9c1c903c699e None admin] RBAC: Authorizing `identity:create_grant(project_id=0f2cd7bacc114313a9a83d8bacdefdcf, user_id=411e88250df044a993d8eb39d988390b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:17.430084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ade9-a7eb-46f7-8ad5-9c1c903c699e None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:17.523516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 647/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Aug 24 03:30:17 2022] PUT /identity/v3/projects/0f2cd7bacc114313a9a83d8bacdefdcf/users/411e88250df044a993d8eb39d988390b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:30:19.413755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e2d3-1923-4c91-8270-47f641c4ddfe None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:19.414366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e2d3-1923-4c91-8270-47f641c4ddfe None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:19.414366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0e2d3-1923-4c91-8270-47f641c4ddfe None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:19.415674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 627/1274] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:19.421021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:19.421452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:19.421574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:19.441114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:19.442340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:19.513112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 648/1275] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:19.776953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0e2d3-1923-4c91-8270-47f641c4ddfe None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:19.883161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0e2d3-1923-4c91-8270-47f641c4ddfe None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:19.901489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:19.922453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:19.925553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:19.925553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:19.925553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:19.934451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 03:30:19.939129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:19.940418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:19.941303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 628/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Aug 24 03:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:19.946694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.032472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.051376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72eb2b-5c85-4057-ad1d-d9b48779d8d7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.085469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.086146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.086434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.086712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.087405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:20.087725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.089197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:20.097961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 649/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Aug 24 03:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:20.103839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.206767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ef3b2-90ca-4156-a31b-98835412e475 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.242244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.242875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.243166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.243426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.254319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.255779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:20.270654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:20.271837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:20.272972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:20.272972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:20.272972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:20.272972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 629/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:20.279513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.382335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcc66e-a591-4f5a-9b1f-112575c636c1 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.415722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.416322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.416603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.416874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.417504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:20.417831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.419232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:20.430888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 650/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:20.436670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.468781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.535692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887089be-c758-4269-83c8-1029b68e63e7 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.569028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.569690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.570004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.570281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.577833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.579266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 03:30:20.590687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:20.597296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:20.598371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 630/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:20.599008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.601636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.699208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d299-2316-4e64-94f4-4ff9996cafbd None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.729510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.730140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.730434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.730739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.731454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:20.731755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.733156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:20.750259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 651/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Aug 24 03:30:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:20.756751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:20.847944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:20.857151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a875e8-20b4-4a45-9e7f-1ca9b37a1443 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:20.890493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:20.891098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:20.891380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:20.891652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:20.958209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:20.959588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.046646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:21.057483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 631/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Aug 24 03:30:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 03:30:21.063399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:21.127537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:21.168050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bbb1b-fdac-493f-a8d4-615b711309a0 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:21.203309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:21.203959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:21.204243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:21.204521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:21.214533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:21.215926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 03:30:21.231187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:21.238908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 03:30:21.240050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 03:30:21.240050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 03:30:21.240050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:21.240050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 652/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:21.240356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:21.339575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09bd4a-2632-4a11-a6ef-cb983bd932da None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:21.374074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:21.374683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:21.374961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:21.375228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:21.375879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:21.376169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:21.377522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.389190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 632/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Aug 24 03:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:21.395446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:21.499523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd52b4-87d0-434f-a266-5948b9264e78 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:21.513591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:21.533064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:21.533731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:21.534045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:21.534321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:21.540959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:21.542426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 03:30:21.553924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:21.555010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: ERROR keystone.server.flask.application Aug 24 03:30:21.556336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 653/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Aug 24 03:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:21.560941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:21.612038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:21.660978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890a8cf-87bf-4286-87af-4ed029b8a3d8 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:21.694289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:21.694887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:21.695166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:21.695434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:21.696119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:21.696421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:21.697867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d235f-70dc-4b1c-9e78-6822c205a33b None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.709450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 633/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Aug 24 03:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:21.715839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:21.817035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17934861-e12a-4e10-b0e7-be5b4ac80257 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:21.849856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:21.850432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:21.850712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:21.850976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:21.851726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] RBAC: Adding query filter params (role.id=bde35209edd64a3187d196af53f70e5d, scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf, user.id=411e88250df044a993d8eb39d988390b) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:21.852030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:21.853437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f0c61-b823-41a0-936e-482cdb6ecc32 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:21.859219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 654/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Aug 24 03:30:21 2022] GET /identity/v3/role_assignments?user.id=411e88250df044a993d8eb39d988390b&scope.project.id=0f2cd7bacc114313a9a83d8bacdefdcf&role.id=bde35209edd64a3187d196af53f70e5d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:23.816939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167408d-d9cb-44a1-bddd-0f613f206899 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:23.817621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167408d-d9cb-44a1-bddd-0f613f206899 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:23.817621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167408d-d9cb-44a1-bddd-0f613f206899 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:23.818867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 634/1288] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:23.824647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:23.825111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:23.825225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:23.853723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:23.854965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:23.884290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:23.925843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 655/1289] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 03:30:24.206960 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167408d-d9cb-44a1-bddd-0f613f206899 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:24.310344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167408d-d9cb-44a1-bddd-0f613f206899 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:24.322146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:24.346684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:24.347314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:24.347598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:24.347872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:24.348451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:24.349851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:24.358854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:24.360304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:24.370178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 635/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:30:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:24.371248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:24.468117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb7ae-692a-486e-9d98-a94d52edcb0e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:24.503328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:24.503952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:24.506979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:24.506979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:24.506979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] RBAC: Adding query filter params (name=placement) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:24.506979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:24.506979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63ce93-255e-4014-b9ad-6a51eeb7beac None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:24.511844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 656/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:24.518528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:24.619578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89874a2c-f7b5-4ff4-908b-5805348e5570 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:24.652317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:24.655829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:24.655829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:24.655829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] PATH_INFO: `/v3/services` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:24.655829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:24.655829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:24.655829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3e52c-a4db-4b1a-b78a-cefc3bc3d0d6 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:24.660028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 636/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:26.559227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdc4a1-139b-4b66-ba28-4260526a1742 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:26.559878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdc4a1-139b-4b66-ba28-4260526a1742 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:26.559878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdc4a1-139b-4b66-ba28-4260526a1742 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:26.561141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 657/1293] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:26.567444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9ad7-4ece-44ef-a822-df877e47ba66 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:26.567929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9ad7-4ece-44ef-a822-df877e47ba66 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:26.568027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f9ad7-4ece-44ef-a822-df877e47ba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:26.586620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-245f9ad7-4ece-44ef-a822-df877e47ba66 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:26.587820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-245f9ad7-4ece-44ef-a822-df877e47ba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:26.618330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:26.655248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 637/1294] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:26.929341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdc4a1-139b-4b66-ba28-4260526a1742 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:26.960842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:27.034518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdc4a1-139b-4b66-ba28-4260526a1742 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:27.068004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5090bf5-9bdf-4e95-b2f7-d2549bcd6faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:27.068605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5090bf5-9bdf-4e95-b2f7-d2549bcd6faf None admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:27.068887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5090bf5-9bdf-4e95-b2f7-d2549bcd6faf None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:27.069159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5090bf5-9bdf-4e95-b2f7-d2549bcd6faf None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:27.069836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5090bf5-9bdf-4e95-b2f7-d2549bcd6faf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:27.071314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5090bf5-9bdf-4e95-b2f7-d2549bcd6faf None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:27.167096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 658/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Aug 24 03:30:26 2022] POST /identity/v3/services => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:30:29.094419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ec19-001e-4f6d-af01-d9896b6ff51a None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.095500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ec19-001e-4f6d-af01-d9896b6ff51a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.095608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ec19-001e-4f6d-af01-d9896b6ff51a None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.096883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 638/1296] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:29.102220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.102678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.102780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.120841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:29.122074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:29.195219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 659/1297] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:29.494289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ec19-001e-4f6d-af01-d9896b6ff51a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:29.604500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ec19-001e-4f6d-af01-d9896b6ff51a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:29.642884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:29.643514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.643795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.644069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.644693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:29.646078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:29.654820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:29.656112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:29.657224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 639/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:30:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:29.662755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:29.681865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:29.764531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289f6ea-beb6-4d11-be51-697cb502694f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:29.798693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:29.799312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.799587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.799860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.800489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:29.800794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:29.802185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:29.807163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 660/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:29.813402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:29.846642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:29.919122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb379-bcdf-4c1f-90be-be54132c8442 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:29.957147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:29.957745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:29.958064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:29.958328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:29.959021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] RBAC: Adding query filter params (interface=public, service_id=2a9d133cb15a4b0b962a3603398a787b, region_id=RegionOne) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:29.959322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:29.960678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca43668-19a7-4b20-a9fb-092ff47d318d None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:29.965855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 640/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Aug 24 03:30:29 2022] GET /identity/v3/endpoints?service_id=2a9d133cb15a4b0b962a3603398a787b&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:29.972207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:30.060784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:30.080078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241d62d-ddaa-45ee-8366-80a68b84db48 None admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:30.114074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc7f0-a1ad-4a41-82d4-9660c78edb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:30.114749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc7f0-a1ad-4a41-82d4-9660c78edb04 None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:30.114949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc7f0-a1ad-4a41-82d4-9660c78edb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:30.115222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc7f0-a1ad-4a41-82d4-9660c78edb04 None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:30.115824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc7f0-a1ad-4a41-82d4-9660c78edb04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:30.117186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc7f0-a1ad-4a41-82d4-9660c78edb04 None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:30.124011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 661/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Aug 24 03:30:29 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:30:32.070352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a174-974c-46d4-9b12-d462488a7c6f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.070884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a174-974c-46d4-9b12-d462488a7c6f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.070884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7a174-974c-46d4-9b12-d462488a7c6f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.072435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 641/1302] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:30:32.077940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.078353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.078564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.097599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:30:32.098854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:30:32.165110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 662/1303] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:30:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 03:30:32.431355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7a174-974c-46d4-9b12-d462488a7c6f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:32.529737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:32.536630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7a174-974c-46d4-9b12-d462488a7c6f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:32.569904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:32.570532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.570809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.571079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.571682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:32.573043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 03:30:32.582177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 03:30:32.583452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application with Lock( Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self._enter() Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application return self.creator() Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application created_value = creator( Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: ERROR keystone.server.flask.application Aug 24 03:30:32.584344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 642/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Aug 24 03:30:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 03:30:32.589383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:32.665803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:32.689356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a75ced-0d95-4ebd-ba03-53e51066d81c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:32.723119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:32.723770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.724052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.724325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] PATH_INFO: `/v3/services` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.724959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:30:32.725265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:32.726739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25424b65-9d1b-411c-9da1-84abd6268f1a None admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:32.731752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 663/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Aug 24 03:30:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:30:32.738257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:30:32.844271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5f21-e56b-43fe-b74e-133a020cdf60 None admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:30:32.878054 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca260162-7a95-44ba-812e-6181f107133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:30:32.878661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260162-7a95-44ba-812e-6181f107133a None admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:30:32.878942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260162-7a95-44ba-812e-6181f107133a None admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:30:32.879216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca260162-7a95-44ba-812e-6181f107133a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:30:32.879971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca260162-7a95-44ba-812e-6181f107133a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:30:32.881253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca260162-7a95-44ba-812e-6181f107133a None admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:30:33.000090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 643/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:30:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:30:42.813422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=30 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:30:42.995107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:17.968157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc22a-2b79-4ed2-8907-3c553018d572 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:17.969236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc22a-2b79-4ed2-8907-3c553018d572 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:17.969732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52dc22a-2b79-4ed2-8907-3c553018d572 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:17.974226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 664/1307] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:17.977676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07600fc1-ea79-44c5-b248-880b6018bbaa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:17.978692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07600fc1-ea79-44c5-b248-880b6018bbaa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:17.979188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07600fc1-ea79-44c5-b248-880b6018bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.080129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-07600fc1-ea79-44c5-b248-880b6018bbaa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:18.081785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-07600fc1-ea79-44c5-b248-880b6018bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:18.214353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 644/1308] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:18.527196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf09c-d9f4-4069-bb8d-7399a0caa56f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.527482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf09c-d9f4-4069-bb8d-7399a0caa56f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.528281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdf09c-d9f4-4069-bb8d-7399a0caa56f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.532011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 665/1309] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 24 03:39:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:18.538224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57664-819b-429e-87a1-904ddaf3ab40 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.538522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57664-819b-429e-87a1-904ddaf3ab40 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.538799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57664-819b-429e-87a1-904ddaf3ab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.639671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1fc57664-819b-429e-87a1-904ddaf3ab40 None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:18.640916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1fc57664-819b-429e-87a1-904ddaf3ab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:18.672385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:18.734737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 645/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 24 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:18.745180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf09c-d9f4-4069-bb8d-7399a0caa56f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:18.747255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0fcdf09c-d9f4-4069-bb8d-7399a0caa56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:18.878975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdf09c-d9f4-4069-bb8d-7399a0caa56f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:18.979011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:18.980329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:18.980930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:18.981355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:18.983274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:19.051855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:19.115503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:19.116941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231559f3-1847-42e0-9ff9-c45dabfe62fd service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:19.136948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 666/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:21.392812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adce9a-b0bf-44a1-b5a3-53d5f15c403d None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:21.393374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adce9a-b0bf-44a1-b5a3-53d5f15c403d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:21.393374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adce9a-b0bf-44a1-b5a3-53d5f15c403d None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:21.394865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 646/1312] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:21.400693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37964abe-b18f-4c8b-a4f3-24d301c1f7e2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:21.401211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37964abe-b18f-4c8b-a4f3-24d301c1f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:21.401324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37964abe-b18f-4c8b-a4f3-24d301c1f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:21.490903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-37964abe-b18f-4c8b-a4f3-24d301c1f7e2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:21.492133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-37964abe-b18f-4c8b-a4f3-24d301c1f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:21.604580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 667/1313] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:21.893577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adce9a-b0bf-44a1-b5a3-53d5f15c403d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:21.895223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-50adce9a-b0bf-44a1-b5a3-53d5f15c403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:22.001883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adce9a-b0bf-44a1-b5a3-53d5f15c403d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:22.076337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:22.078848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:22.079452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:22.079728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:22.079996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:22.081603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:22.191951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:22.193403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c338970-998b-4eab-aea2-98cf35952f6a service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:22.211391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 647/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:24.738883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5d74d-a0af-4850-891f-213302cf9ab9 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:24.739392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5d74d-a0af-4850-891f-213302cf9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:24.739392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5d74d-a0af-4850-891f-213302cf9ab9 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:24.740700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 668/1315] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:24.746279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637c431-cf07-4f4a-8d05-9077cc3e1bcd None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:24.746802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637c431-cf07-4f4a-8d05-9077cc3e1bcd None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:24.746802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637c431-cf07-4f4a-8d05-9077cc3e1bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:24.815217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9637c431-cf07-4f4a-8d05-9077cc3e1bcd None None] MFA Rules not processed for user `bda4269ce4624e36a0a082bab7f4df80`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:24.816440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9637c431-cf07-4f4a-8d05-9077cc3e1bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:24.867755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:24.912346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 648/1316] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:25.205888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5d74d-a0af-4850-891f-213302cf9ab9 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:25.207437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-63b5d74d-a0af-4850-891f-213302cf9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:25.217186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:25.310678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5d74d-a0af-4850-891f-213302cf9ab9 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:25.384014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:25.384622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:25.384920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:25.385178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:25.386820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:25.449671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:25.495680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:25.497126 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7a2eb-9e15-4b50-a679-91968ae88f24 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:25.516430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 669/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:28.197419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475465b8-7d20-4b59-8e5b-32573f2c05d7 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:28.198065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475465b8-7d20-4b59-8e5b-32573f2c05d7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:28.198065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475465b8-7d20-4b59-8e5b-32573f2c05d7 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:28.199361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 649/1318] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:28.204719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896173-8070-4a55-a19d-5b252420c27d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:28.205142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896173-8070-4a55-a19d-5b252420c27d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:28.205270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896173-8070-4a55-a19d-5b252420c27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:28.272600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a6896173-8070-4a55-a19d-5b252420c27d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:28.273876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a6896173-8070-4a55-a19d-5b252420c27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:28.370828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 670/1319] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:28.678621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ce46-214a-467f-baa5-2c9dbfd13512 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:28.678909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ce46-214a-467f-baa5-2c9dbfd13512 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:28.679187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8ce46-214a-467f-baa5-2c9dbfd13512 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:28.680547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 650/1320] 10.222.0.40 () {54 vars in 965 bytes} [Wed Aug 24 03:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:28.686490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6fb74-b05f-49d2-b1d1-45e1588191ff None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:28.686792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6fb74-b05f-49d2-b1d1-45e1588191ff None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:28.687069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6fb74-b05f-49d2-b1d1-45e1588191ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:28.708610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:28.762304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-39f6fb74-b05f-49d2-b1d1-45e1588191ff None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:28.763444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-39f6fb74-b05f-49d2-b1d1-45e1588191ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:28.838951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 671/1321] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Aug 24 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:28.848704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ce46-214a-467f-baa5-2c9dbfd13512 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:28.850294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-afa8ce46-214a-467f-baa5-2c9dbfd13512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:28.953238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8ce46-214a-467f-baa5-2c9dbfd13512 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:29.044918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:29.045550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:29.046018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:29.046402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:29.047894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:29.055677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:29.157792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:29.159307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83675b2f-c7e3-4c24-9eb1-b3db8ab4c82d service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:29.177862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 651/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:32.559160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da7b4-1a44-4444-adef-5cc24586f33f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:32.559698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da7b4-1a44-4444-adef-5cc24586f33f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:32.559698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543da7b4-1a44-4444-adef-5cc24586f33f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:32.561222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 672/1323] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:32.566526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f574-e0c4-4350-9382-dd67d9a06224 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:32.566972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f574-e0c4-4350-9382-dd67d9a06224 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:32.567235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5f574-e0c4-4350-9382-dd67d9a06224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:32.634809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-09f5f574-e0c4-4350-9382-dd67d9a06224 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:32.636013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-09f5f574-e0c4-4350-9382-dd67d9a06224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:32.698064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:32.737686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 652/1324] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:33.018537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543da7b4-1a44-4444-adef-5cc24586f33f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:33.020204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-543da7b4-1a44-4444-adef-5cc24586f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:33.148635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543da7b4-1a44-4444-adef-5cc24586f33f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:33.161860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:33.228001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:33.228612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:33.228895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:33.229171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:33.230835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:33.345122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:33.346519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88572e8-52bc-4b71-bbe9-89d37c0488a8 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:33.367494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 673/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:35.338529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbcf2-7fe5-48bc-bcdc-69687d48c44f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:35.339058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbcf2-7fe5-48bc-bcdc-69687d48c44f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:35.339058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbcf2-7fe5-48bc-bcdc-69687d48c44f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:35.340419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 653/1326] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:35.346186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9602b-3eeb-4f53-93ee-1c138d3b82ee None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:35.346630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9602b-3eeb-4f53-93ee-1c138d3b82ee None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:35.346758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9602b-3eeb-4f53-93ee-1c138d3b82ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:35.396129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:35.414680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4dc9602b-3eeb-4f53-93ee-1c138d3b82ee None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:35.415894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4dc9602b-3eeb-4f53-93ee-1c138d3b82ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:35.520457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 674/1327] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:35.798171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbcf2-7fe5-48bc-bcdc-69687d48c44f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:35.799685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4e6cbcf2-7fe5-48bc-bcdc-69687d48c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:35.909391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbcf2-7fe5-48bc-bcdc-69687d48c44f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:35.990255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:35.990872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:35.991154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:35.991425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:35.993029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:36.010607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:36.117433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:36.118944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72457bd4-88eb-40d4-9967-3bcf3c2344a8 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:36.138010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 654/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:38.123452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a298adc-2943-4ecc-a678-0833198641f0 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:38.124100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a298adc-2943-4ecc-a678-0833198641f0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:38.124100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a298adc-2943-4ecc-a678-0833198641f0 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:38.125422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 675/1329] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:38.130923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b83551-ce76-428c-aa73-ca5bceebfbb7 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:38.131372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b83551-ce76-428c-aa73-ca5bceebfbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:38.131597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b83551-ce76-428c-aa73-ca5bceebfbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:38.202737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-41b83551-ce76-428c-aa73-ca5bceebfbb7 None None] MFA Rules not processed for user `bda4269ce4624e36a0a082bab7f4df80`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:38.203992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-41b83551-ce76-428c-aa73-ca5bceebfbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:38.272074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:38.310492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 655/1330] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:39:38.599556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a298adc-2943-4ecc-a678-0833198641f0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:38.601158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5a298adc-2943-4ecc-a678-0833198641f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:38.724788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a298adc-2943-4ecc-a678-0833198641f0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:38.746522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:38.804422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:38.805031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:38.805312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:38.805583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:38.807221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:38.917206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:38.918682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80685a52-3a9a-4aae-8421-9dbaa9f52058 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:38.937792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 676/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:41.361310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d27c-f1a9-434b-a369-4fc1c40205ee None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:41.362000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d27c-f1a9-434b-a369-4fc1c40205ee None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:41.362000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10d27c-f1a9-434b-a369-4fc1c40205ee None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:41.363267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 656/1332] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:41.368730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8034b-1ce9-49a5-8625-fd260ab066d1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:41.369176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8034b-1ce9-49a5-8625-fd260ab066d1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:41.369283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8034b-1ce9-49a5-8625-fd260ab066d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:41.433354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:41.435856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-49d8034b-1ce9-49a5-8625-fd260ab066d1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:41.437080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-49d8034b-1ce9-49a5-8625-fd260ab066d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:41.534523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 677/1333] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:41.815170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10d27c-f1a9-434b-a369-4fc1c40205ee None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:41.816747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bc10d27c-f1a9-434b-a369-4fc1c40205ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:41.921156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10d27c-f1a9-434b-a369-4fc1c40205ee None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:41.994288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:41.994812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:41.995087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:41.995350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:41.996989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:42.023949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:42.104829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:42.106286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af520e-2345-451f-b9e4-571a2683478b service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:42.125802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 657/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:44.098847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2e4d7-2b20-4332-915f-55e1f1cb2725 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:44.099392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2e4d7-2b20-4332-915f-55e1f1cb2725 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:44.099392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2e4d7-2b20-4332-915f-55e1f1cb2725 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:44.100741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 678/1335] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:44.106511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14751f-9747-48d0-af47-a4df23a18c1d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:44.106968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14751f-9747-48d0-af47-a4df23a18c1d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:44.107062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14751f-9747-48d0-af47-a4df23a18c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:44.173294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-bc14751f-9747-48d0-af47-a4df23a18c1d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:44.174886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bc14751f-9747-48d0-af47-a4df23a18c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:44.248597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:44.277653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 658/1336] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:44.579402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2e4d7-2b20-4332-915f-55e1f1cb2725 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:44.580973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-17d2e4d7-2b20-4332-915f-55e1f1cb2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:44.685623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2e4d7-2b20-4332-915f-55e1f1cb2725 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:44.713974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:44.758907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:44.759438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:44.759719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:44.759994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:44.761593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:44.878457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:44.879915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e36bc-259b-432f-a62f-1d972cc10037 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:44.899907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 679/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:47.619011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f818-ebe6-4685-bfc0-7d16fc91e320 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:47.619560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f818-ebe6-4685-bfc0-7d16fc91e320 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:47.619560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361f818-ebe6-4685-bfc0-7d16fc91e320 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:47.620917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 659/1338] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:47.626470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7d4a-1912-4c5a-86f4-32e4eff73997 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:47.626981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7d4a-1912-4c5a-86f4-32e4eff73997 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:47.627362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce7d4a-1912-4c5a-86f4-32e4eff73997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:47.692200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-1dce7d4a-1912-4c5a-86f4-32e4eff73997 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:47.693426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1dce7d4a-1912-4c5a-86f4-32e4eff73997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:47.702174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:47.790511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 680/1339] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:48.073278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f818-ebe6-4685-bfc0-7d16fc91e320 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:48.074834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f361f818-ebe6-4685-bfc0-7d16fc91e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:48.178296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361f818-ebe6-4685-bfc0-7d16fc91e320 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:48.253640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:48.254278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:48.254560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:48.254830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:48.256437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:48.291743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:48.364774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:48.366157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb68e4-33a4-4ac2-8c38-03ac909c43b2 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:48.384935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 660/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:52.698891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954568d-91f3-4dfa-bf43-8be51556c68f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:52.699549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954568d-91f3-4dfa-bf43-8be51556c68f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:52.699549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954568d-91f3-4dfa-bf43-8be51556c68f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:52.701755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 681/1341] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:52.707667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63943f-32ca-4174-af5a-3a4b9a66cc2e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:52.708164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63943f-32ca-4174-af5a-3a4b9a66cc2e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:52.708273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63943f-32ca-4174-af5a-3a4b9a66cc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:52.782399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-dd63943f-32ca-4174-af5a-3a4b9a66cc2e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:52.783628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-dd63943f-32ca-4174-af5a-3a4b9a66cc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:52.906222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:52.920922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 661/1342] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:53.212371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954568d-91f3-4dfa-bf43-8be51556c68f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:53.214594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8954568d-91f3-4dfa-bf43-8be51556c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:53.329910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954568d-91f3-4dfa-bf43-8be51556c68f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:53.369680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:53.413069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:53.413676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:53.413987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:53.414262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:53.415876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:53.526480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:53.527914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b076910-7a51-4980-a5d9-60edad44ea02 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:53.547376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 682/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:39:56.472405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59b5c-7803-45fc-9346-2bfd27bbc47a None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:56.472958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59b5c-7803-45fc-9346-2bfd27bbc47a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:56.472958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d59b5c-7803-45fc-9346-2bfd27bbc47a None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:56.474344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 662/1344] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:39:56.479584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e812f-2878-4aa0-9615-da259bac9a66 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:56.480005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e812f-2878-4aa0-9615-da259bac9a66 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:56.480141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e812f-2878-4aa0-9615-da259bac9a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:56.548508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ef2e812f-2878-4aa0-9615-da259bac9a66 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:39:56.549952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ef2e812f-2878-4aa0-9615-da259bac9a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:56.568925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:56.648019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 683/1345] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:39:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:39:56.930792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d59b5c-7803-45fc-9346-2bfd27bbc47a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:39:56.932435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f3d59b5c-7803-45fc-9346-2bfd27bbc47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.047982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d59b5c-7803-45fc-9346-2bfd27bbc47a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:39:57.125160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:39:57.125846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:39:57.126077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:39:57.126348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:39:57.127947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:39:57.175225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:39:57.243973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:39:57.245438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382489d-c005-4704-b40f-c8423be18f19 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:39:57.265639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 663/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:39:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:01.640272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7cfbf-71f1-42b4-b980-7e3a82de1374 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:01.640739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7cfbf-71f1-42b4-b980-7e3a82de1374 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:01.640852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7cfbf-71f1-42b4-b980-7e3a82de1374 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:01.642419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 684/1347] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:01.647839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1749c2-b5b0-4824-9c3b-19f55f805f41 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:01.648448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1749c2-b5b0-4824-9c3b-19f55f805f41 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:01.648715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1749c2-b5b0-4824-9c3b-19f55f805f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:01.729437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1a1749c2-b5b0-4824-9c3b-19f55f805f41 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:01.730888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1a1749c2-b5b0-4824-9c3b-19f55f805f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:01.847693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:01.850124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 664/1348] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:02.141602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7cfbf-71f1-42b4-b980-7e3a82de1374 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:02.143319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cff7cfbf-71f1-42b4-b980-7e3a82de1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:02.255786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7cfbf-71f1-42b4-b980-7e3a82de1374 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:02.306413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:02.333223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:02.333872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:02.334160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:02.334439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:02.336039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:02.445163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:02.446606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce3584-44af-4cfd-b4cf-71f59201f0b0 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:02.466374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 685/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:07.470348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72a6e-e91a-4643-9cfd-b5f3c2f88bee None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:07.471559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72a6e-e91a-4643-9cfd-b5f3c2f88bee None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:07.472058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e72a6e-e91a-4643-9cfd-b5f3c2f88bee None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:07.474463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 665/1350] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:07.484045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0971dbf-74d3-41cc-9dc2-e8cad6a8b4b7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:07.484045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0971dbf-74d3-41cc-9dc2-e8cad6a8b4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:07.484045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0971dbf-74d3-41cc-9dc2-e8cad6a8b4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:07.588680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c0971dbf-74d3-41cc-9dc2-e8cad6a8b4b7 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:07.591252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c0971dbf-74d3-41cc-9dc2-e8cad6a8b4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:07.661917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:07.778891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 686/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:40:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:11.967608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d091-0937-43a7-90f1-047d792854e1 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:11.968185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d091-0937-43a7-90f1-047d792854e1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:11.968185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d091-0937-43a7-90f1-047d792854e1 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:11.969741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 666/1352] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:11.974715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fe369-2ad4-4fc6-9bcc-f7dc9e975348 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:11.975607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fe369-2ad4-4fc6-9bcc-f7dc9e975348 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:11.976109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fe369-2ad4-4fc6-9bcc-f7dc9e975348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:12.064884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7e6fe369-2ad4-4fc6-9bcc-f7dc9e975348 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:12.066267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7e6fe369-2ad4-4fc6-9bcc-f7dc9e975348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:12.142439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:12.181698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 687/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:13.552352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d23aae-646d-4896-9e75-94b862336b02 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:13.552911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d23aae-646d-4896-9e75-94b862336b02 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:13.552911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d23aae-646d-4896-9e75-94b862336b02 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:13.554449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 667/1354] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:13.559660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c53bf-7c49-46fb-a33f-8d27ca2d2518 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:13.560134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c53bf-7c49-46fb-a33f-8d27ca2d2518 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:13.560474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c53bf-7c49-46fb-a33f-8d27ca2d2518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:13.636993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4c6c53bf-7c49-46fb-a33f-8d27ca2d2518 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:13.638235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4c6c53bf-7c49-46fb-a33f-8d27ca2d2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:13.747356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 688/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:40:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:17.091976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8ff95-815a-4aab-9520-5d201e85308c None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:17.092487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8ff95-815a-4aab-9520-5d201e85308c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:17.092591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8ff95-815a-4aab-9520-5d201e85308c None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:17.093949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 668/1356] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:17.099377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cd71-4e8a-42be-9cb0-c5451dd764e6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:17.099814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cd71-4e8a-42be-9cb0-c5451dd764e6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:17.100068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cd71-4e8a-42be-9cb0-c5451dd764e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:17.152636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:17.187176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-db17cd71-4e8a-42be-9cb0-c5451dd764e6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:17.188470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-db17cd71-4e8a-42be-9cb0-c5451dd764e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:17.350761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 689/1357] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:17.658301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64da3-ef08-4689-8056-0ceb49f69b2e None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:17.658899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64da3-ef08-4689-8056-0ceb49f69b2e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:17.659376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e64da3-ef08-4689-8056-0ceb49f69b2e None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:17.661161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 669/1358] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 24 03:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:17.669674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5415-4b72-49f1-aa95-51ea446e0713 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:17.670035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5415-4b72-49f1-aa95-51ea446e0713 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:17.675320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5415-4b72-49f1-aa95-51ea446e0713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:17.769010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7f2d5415-4b72-49f1-aa95-51ea446e0713 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:17.770270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7f2d5415-4b72-49f1-aa95-51ea446e0713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:17.837865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:17.910111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 690/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 24 03:40:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:17.918100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64da3-ef08-4689-8056-0ceb49f69b2e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:17.919606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-79e64da3-ef08-4689-8056-0ceb49f69b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:18.088165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e64da3-ef08-4689-8056-0ceb49f69b2e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:18.171129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:18.215930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:18.216606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:18.216898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:18.217209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:18.218855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:18.315181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:18.316829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43e957-7974-46b7-a81f-9365324c3620 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:18.337045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 670/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:40:20.476609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98a444-1ba9-47c8-9ed5-12766c02e2d8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:20.477060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98a444-1ba9-47c8-9ed5-12766c02e2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:20.477183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98a444-1ba9-47c8-9ed5-12766c02e2d8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:20.478685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 691/1361] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:20.484171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980ae8-5732-4944-80c3-d0e8f19bda71 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:20.484953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980ae8-5732-4944-80c3-d0e8f19bda71 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:20.485231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2980ae8-5732-4944-80c3-d0e8f19bda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:20.555031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c2980ae8-5732-4944-80c3-d0e8f19bda71 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:20.556237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c2980ae8-5732-4944-80c3-d0e8f19bda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:20.597946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:20.665017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 671/1362] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:20.962204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98a444-1ba9-47c8-9ed5-12766c02e2d8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:20.963739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9f98a444-1ba9-47c8-9ed5-12766c02e2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:21.121405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98a444-1ba9-47c8-9ed5-12766c02e2d8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:21.137496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:21.259978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:21.259978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:21.260444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:21.260444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:21.262378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:21.362783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:21.364454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ff4d8-e51b-4044-a2e2-8bede69701e0 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:21.385197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 692/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:23.789442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8027-9501-4ff5-82fe-8a8ab4497092 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:23.789978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8027-9501-4ff5-82fe-8a8ab4497092 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:23.790059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8027-9501-4ff5-82fe-8a8ab4497092 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:23.791379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 672/1364] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:23.797151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac2df1-df0c-428f-b4d3-72a0d4651be1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:23.797571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac2df1-df0c-428f-b4d3-72a0d4651be1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:23.797790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac2df1-df0c-428f-b4d3-72a0d4651be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:23.814605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:23.868539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7cac2df1-df0c-428f-b4d3-72a0d4651be1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:23.869757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7cac2df1-df0c-428f-b4d3-72a0d4651be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:23.983328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 693/1365] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:24.265674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b49d1-f70d-482b-9eba-03df61597764 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.266209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b49d1-f70d-482b-9eba-03df61597764 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.266520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b49d1-f70d-482b-9eba-03df61597764 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.267905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 673/1366] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 24 03:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:24.273868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d0f6-3814-499f-8bb1-0914d6fdf9d1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.274154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d0f6-3814-499f-8bb1-0914d6fdf9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.274450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34d0f6-3814-499f-8bb1-0914d6fdf9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.354855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-5e34d0f6-3814-499f-8bb1-0914d6fdf9d1 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:24.356029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5e34d0f6-3814-499f-8bb1-0914d6fdf9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.392472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.488444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 694/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 24 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:24.498216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b49d1-f70d-482b-9eba-03df61597764 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:24.500037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cb2b49d1-f70d-482b-9eba-03df61597764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.659033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b49d1-f70d-482b-9eba-03df61597764 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:24.688525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:24.792488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:24.793862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:24.794145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:24.794420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:24.796009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:24.889326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:24.891243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db2e50-76e1-4278-bd61-7d94c58d176a service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:24.911347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 674/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:40:25.610120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae656dfd-6a40-4791-aebd-fe2b6bc57cc2 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:25.610649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae656dfd-6a40-4791-aebd-fe2b6bc57cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:25.610649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae656dfd-6a40-4791-aebd-fe2b6bc57cc2 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:25.612151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 695/1369] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:25.617843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43fecd-aca7-4459-b3c9-cf599b01a9d1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:25.618165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43fecd-aca7-4459-b3c9-cf599b01a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:25.618501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43fecd-aca7-4459-b3c9-cf599b01a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:25.655324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:25.695685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3c43fecd-aca7-4459-b3c9-cf599b01a9d1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:25.696894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3c43fecd-aca7-4459-b3c9-cf599b01a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:25.806776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 675/1370] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:26.405787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20136b-c7cf-4006-82ec-f77a8b7529c6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.406121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20136b-c7cf-4006-82ec-f77a8b7529c6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.406457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20136b-c7cf-4006-82ec-f77a8b7529c6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.407945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 696/1371] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 24 03:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:26.413360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9955-d3a4-48e8-81ca-c83caf21adf6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.413728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9955-d3a4-48e8-81ca-c83caf21adf6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.414116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf9955-d3a4-48e8-81ca-c83caf21adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.498909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-42cf9955-d3a4-48e8-81ca-c83caf21adf6 None None] MFA Rules not processed for user `db35ea7cc80d49caa8187dcde2d55642`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:26.500142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-42cf9955-d3a4-48e8-81ca-c83caf21adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:26.548478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:26.579654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 676/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 24 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:26.587245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20136b-c7cf-4006-82ec-f77a8b7529c6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:26.588796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ab20136b-c7cf-4006-82ec-f77a8b7529c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:26.698203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20136b-c7cf-4006-82ec-f77a8b7529c6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:26.740668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:26.775429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:26.776048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:26.776327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:26.776718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:26.778400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:26.894819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:26.896249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682516c6-46d5-4bbf-8c10-1edae82103d3 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:26.915576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 697/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:27.071738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9453dff-390e-4a90-91d7-c5b7efba99ec None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:27.072451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9453dff-390e-4a90-91d7-c5b7efba99ec None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:27.072451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9453dff-390e-4a90-91d7-c5b7efba99ec None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:27.079850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 677/1374] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:27.085788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea9ce7-5e24-4fa8-8ed2-d6ec255fcb4f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:27.085788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea9ce7-5e24-4fa8-8ed2-d6ec255fcb4f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:27.085788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea9ce7-5e24-4fa8-8ed2-d6ec255fcb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:27.165750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-61ea9ce7-5e24-4fa8-8ed2-d6ec255fcb4f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:27.167572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-61ea9ce7-5e24-4fa8-8ed2-d6ec255fcb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.189222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.269874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 698/1375] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:27.562239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9453dff-390e-4a90-91d7-c5b7efba99ec None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:27.563779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d9453dff-390e-4a90-91d7-c5b7efba99ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.724614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9453dff-390e-4a90-91d7-c5b7efba99ec None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:27.779376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:27.844655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:27.845259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:27.845538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:27.845839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:27.847482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:27.941384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:27.943002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487901b-32b1-4ef0-86ab-cf61adcdd6b5 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:27.961510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 678/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:30.044145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f964-b681-4ef0-9887-38d6e32bbdbf None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:30.044672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f964-b681-4ef0-9887-38d6e32bbdbf None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:30.044672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1f964-b681-4ef0-9887-38d6e32bbdbf None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:30.046066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 699/1377] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:30.051638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ed49b-fea4-4f6c-bdea-01e571578cfa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:30.052049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ed49b-fea4-4f6c-bdea-01e571578cfa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:30.052214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ed49b-fea4-4f6c-bdea-01e571578cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:30.136917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c21ed49b-fea4-4f6c-bdea-01e571578cfa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:30.138356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c21ed49b-fea4-4f6c-bdea-01e571578cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:30.147536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:30.275432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 679/1378] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:30.572156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f964-b681-4ef0-9887-38d6e32bbdbf None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:30.573707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-96d1f964-b681-4ef0-9887-38d6e32bbdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:30.791939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1f964-b681-4ef0-9887-38d6e32bbdbf None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:30.796087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:30.913735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:30.914497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:30.914846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:30.915189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:30.917447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:31.019107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:31.020699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0806424-1a8a-47d2-9e14-cd1d10da9941 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:31.040062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 700/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:33.128909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be534c-ff31-4785-a4ad-47f942cc4d36 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:33.129439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be534c-ff31-4785-a4ad-47f942cc4d36 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:33.129519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be534c-ff31-4785-a4ad-47f942cc4d36 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:33.131127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 680/1380] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:33.137013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a0f-df97-46b3-a308-9abfc4a5d7f4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:33.137949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a0f-df97-46b3-a308-9abfc4a5d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:33.138291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df0a0f-df97-46b3-a308-9abfc4a5d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:33.149820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:33.210919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a8df0a0f-df97-46b3-a308-9abfc4a5d7f4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:33.212035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a8df0a0f-df97-46b3-a308-9abfc4a5d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:33.325279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 701/1381] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:33.623658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be534c-ff31-4785-a4ad-47f942cc4d36 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:33.625566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-66be534c-ff31-4785-a4ad-47f942cc4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:33.794828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:33.807654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be534c-ff31-4785-a4ad-47f942cc4d36 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:33.944608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:33.945228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:33.945509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:33.945796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:33.947553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:34.046914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:34.048542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6afcd-d59d-4ff2-b5b4-a459ca633449 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:34.060395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:34.074147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 681/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:40:36.229286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc621-5105-44f0-bfb3-f1b7b80c614f None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:36.229874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc621-5105-44f0-bfb3-f1b7b80c614f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:36.229874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc621-5105-44f0-bfb3-f1b7b80c614f None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:36.234953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 702/1383] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:36.237528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cddcad-233a-46a7-956f-911129c3a77f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:36.238036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cddcad-233a-46a7-956f-911129c3a77f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:36.238261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cddcad-233a-46a7-956f-911129c3a77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:36.315161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a5cddcad-233a-46a7-956f-911129c3a77f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:36.316380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a5cddcad-233a-46a7-956f-911129c3a77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:36.435740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 682/1384] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:36.726551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc621-5105-44f0-bfb3-f1b7b80c614f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:36.728131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b12cc621-5105-44f0-bfb3-f1b7b80c614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:36.821115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:36.890086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc621-5105-44f0-bfb3-f1b7b80c614f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:37.012110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:37.012642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:37.012980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:37.013466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:37.016194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:37.078272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:37.121797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:37.123404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d481250-4f91-48b1-8fbb-a4731ca7862b service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:37.143221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 703/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:39.096863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea57bf-1a98-49ab-9718-05dab7f3556b None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:39.097422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea57bf-1a98-49ab-9718-05dab7f3556b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:39.097612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea57bf-1a98-49ab-9718-05dab7f3556b None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:39.099446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 683/1386] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:39.105758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b9c4-e721-4c0e-8de0-29225163e60a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:39.106408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b9c4-e721-4c0e-8de0-29225163e60a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:39.106408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64b9c4-e721-4c0e-8de0-29225163e60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:39.176579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9c64b9c4-e721-4c0e-8de0-29225163e60a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:39.178326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9c64b9c4-e721-4c0e-8de0-29225163e60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:39.286424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 704/1387] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:39.693721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea57bf-1a98-49ab-9718-05dab7f3556b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:39.695280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2dea57bf-1a98-49ab-9718-05dab7f3556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:39.774769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:39.851559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea57bf-1a98-49ab-9718-05dab7f3556b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:40.003600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:40.004408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:40.004775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:40.005153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:40.006917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:40.064510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:40.141287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:40.144303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dfe379-7e8a-4caa-85af-e68dec88f8b3 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:40.174842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 684/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:42.481812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5530-ce72-49e4-9441-18022292413c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.482314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5530-ce72-49e4-9441-18022292413c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.482490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5530-ce72-49e4-9441-18022292413c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.483755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 705/1389] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:42.489169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.490851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.490851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.562667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:42.563916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:42.589616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a29a9a-8acd-4749-9233-30500b285d98 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.589934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a29a9a-8acd-4749-9233-30500b285d98 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.590211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a29a9a-8acd-4749-9233-30500b285d98 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.591574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 706/1390] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:42.596867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81690f8-b556-47e5-bf9e-a45fa978ff2e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:42.597153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81690f8-b556-47e5-bf9e-a45fa978ff2e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:42.597435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81690f8-b556-47e5-bf9e-a45fa978ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:42.634691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:42.667078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b81690f8-b556-47e5-bf9e-a45fa978ff2e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:42.667585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 685/1391] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:42.668307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b81690f8-b556-47e5-bf9e-a45fa978ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:42.772630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 707/1392] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:42.975481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:42.976891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:42.990706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:43.079147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d01fc-71a1-4121-9373-496c8e78d8f5 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:43.079619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d01fc-71a1-4121-9373-496c8e78d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:43.079901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d01fc-71a1-4121-9373-496c8e78d8f5 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:43.081359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 708/1393] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 24 03:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:40:43.086157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:43.086444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:43.086718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:43.106799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc962ccb-f814-4bf6-b975-901cfb5ed312 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:43.173227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] MFA Rules not processed for user `fc5b05e5e96a4afc95ab176576b92577`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:43.174483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:43.224176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:43.233443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:43.239031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:43.239031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:43.239031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:43.239031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:43.245292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:43.252925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 709/1394] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 24 03:40:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:43.261106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:43.269032 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f255-bf50-4c76-b063-9eac8577b068 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:43.331755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:43.333276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbdcd7a-8368-4acc-ab5d-3435d1959565 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:43.345080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:43.345691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:43.346002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:43.346280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:43.347887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:43.354838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 686/1395] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:43.464954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:43.466558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80ee8c-d8c8-458e-91db-a20db4b42816 service glance] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:43.482244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:43.486960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 710/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:40:44.375131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d05c9-6a11-4a23-abf6-dcdd1957b35d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:44.375652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d05c9-6a11-4a23-abf6-dcdd1957b35d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:44.375751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d05c9-6a11-4a23-abf6-dcdd1957b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:44.444337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-028d05c9-6a11-4a23-abf6-dcdd1957b35d None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:44.445563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-028d05c9-6a11-4a23-abf6-dcdd1957b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:44.534456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:44.537843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 687/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:44.586157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d91fa-a560-48ab-9f57-3aa8f7eb1a67 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:44.586639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d91fa-a560-48ab-9f57-3aa8f7eb1a67 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:44.586739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d91fa-a560-48ab-9f57-3aa8f7eb1a67 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:44.588235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 711/1398] 10.222.0.40 () {54 vars in 943 bytes} [Wed Aug 24 03:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:44.594535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e7963-6b1d-4301-9a46-6360138c79d7 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:44.594831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e7963-6b1d-4301-9a46-6360138c79d7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:44.595110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e7963-6b1d-4301-9a46-6360138c79d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:44.676749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-801e7963-6b1d-4301-9a46-6360138c79d7 None None] MFA Rules not processed for user `86600b9afdbf43808b4745828a1d3756`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:44.677819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-801e7963-6b1d-4301-9a46-6360138c79d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:44.789959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 688/1399] 10.222.0.40 () {58 vars in 1040 bytes} [Wed Aug 24 03:40:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:40:44.800144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d91fa-a560-48ab-9f57-3aa8f7eb1a67 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:44.801817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fa1d91fa-a560-48ab-9f57-3aa8f7eb1a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:44.939803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d91fa-a560-48ab-9f57-3aa8f7eb1a67 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:45.030043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:45.050555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:45.051453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:45.051453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:45.051697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:45.054014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:45.141568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:45.143199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e5a37-9adf-4205-9c47-67d1a1b6d208 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:45.151469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 712/1400] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:40:45.485311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6a02d-0538-4ec4-9fda-50c1842b465d None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:45.485868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6a02d-0538-4ec4-9fda-50c1842b465d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:45.485981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6a02d-0538-4ec4-9fda-50c1842b465d None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:45.487335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 689/1401] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:45.492873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5705a6-890f-419c-8315-12c5d50d99b5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:45.493259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5705a6-890f-419c-8315-12c5d50d99b5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:45.494147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5705a6-890f-419c-8315-12c5d50d99b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:45.566686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-1c5705a6-890f-419c-8315-12c5d50d99b5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:45.568624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1c5705a6-890f-419c-8315-12c5d50d99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:45.641507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:45.670920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 713/1402] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:45.976470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6a02d-0538-4ec4-9fda-50c1842b465d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:45.978546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a3d6a02d-0538-4ec4-9fda-50c1842b465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:46.053143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:46.177013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6a02d-0538-4ec4-9fda-50c1842b465d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:46.310427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:46.311061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:46.311418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:46.311760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:46.313444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:46.334458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:46.417398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:46.420870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ba63f-f382-4c6e-96c4-b5a5279007ba service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:46.440137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 690/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:48.598663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711048c8-090c-4cf6-b651-e6f538cb7438 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.599229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711048c8-090c-4cf6-b651-e6f538cb7438 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.599345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711048c8-090c-4cf6-b651-e6f538cb7438 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.600789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 714/1404] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:48.609102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470801-3774-400b-9dbe-562e521cfcbf None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:48.609723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470801-3774-400b-9dbe-562e521cfcbf None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:48.610236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2470801-3774-400b-9dbe-562e521cfcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:48.700362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d2470801-3774-400b-9dbe-562e521cfcbf None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:48.701921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d2470801-3774-400b-9dbe-562e521cfcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:48.824070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:48.875579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 691/1405] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:49.128343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711048c8-090c-4cf6-b651-e6f538cb7438 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:49.129925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-711048c8-090c-4cf6-b651-e6f538cb7438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:49.298315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711048c8-090c-4cf6-b651-e6f538cb7438 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:49.363786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:49.439167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:49.439831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:49.440142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:49.440413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:49.442215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:49.549425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:49.550748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee01155-297d-47f8-9b12-2c1ae77391c8 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:49.572844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 715/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:40:51.750298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901781c-332f-44d1-8ee2-bcfca59ffb70 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.750872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901781c-332f-44d1-8ee2-bcfca59ffb70 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.750872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901781c-332f-44d1-8ee2-bcfca59ffb70 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.752246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 692/1407] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:40:51.757717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf892c-16a8-469f-ac89-251a9b3d9df0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:51.758170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf892c-16a8-469f-ac89-251a9b3d9df0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:51.758412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf892c-16a8-469f-ac89-251a9b3d9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:51.835152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-beaf892c-16a8-469f-ac89-251a9b3d9df0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:40:51.836370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-beaf892c-16a8-469f-ac89-251a9b3d9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:51.856402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:51.949546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 716/1408] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:40:52.236575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901781c-332f-44d1-8ee2-bcfca59ffb70 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:40:52.238111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2901781c-332f-44d1-8ee2-bcfca59ffb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:52.397308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901781c-332f-44d1-8ee2-bcfca59ffb70 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:40:52.484301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:40:52.540722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:40:52.541848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:40:52.542326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:40:52.543604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:40:52.546585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:40:52.655977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:40:52.657709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf08a2-b0da-4820-beb9-57b794218eda service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:40:52.681407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 693/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:01.947904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=38 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:02.675795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=64 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:09.251579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bfdd2-2640-4b7e-b0a0-efce6878e817 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:09.252121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bfdd2-2640-4b7e-b0a0-efce6878e817 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:09.252220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bfdd2-2640-4b7e-b0a0-efce6878e817 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:09.253886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 717/1410] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 24 03:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:09.260243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3a22-3f30-4f4c-a5ac-9c25a57ac7c5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:09.260773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3a22-3f30-4f4c-a5ac-9c25a57ac7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:09.260773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f3a22-3f30-4f4c-a5ac-9c25a57ac7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:09.340179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-728f3a22-3f30-4f4c-a5ac-9c25a57ac7c5 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:09.341436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-728f3a22-3f30-4f4c-a5ac-9c25a57ac7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:09.453631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 694/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 24 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:09.468521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9bf38-ed49-40b7-a270-2d4624eff9ba None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:09.468828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9bf38-ed49-40b7-a270-2d4624eff9ba None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:09.469077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9bf38-ed49-40b7-a270-2d4624eff9ba None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:09.470484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 718/1412] 10.222.0.40 () {54 vars in 918 bytes} [Wed Aug 24 03:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:09.476454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429b20-003a-4711-a336-760c3e826ffb None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:09.476454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429b20-003a-4711-a336-760c3e826ffb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:09.476654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429b20-003a-4711-a336-760c3e826ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:09.549013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:09.552114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-69429b20-003a-4711-a336-760c3e826ffb None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:09.553356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-69429b20-003a-4711-a336-760c3e826ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:09.672742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 695/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Aug 24 03:41:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:12.075544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015d13-2ce6-47c1-a4b3-9a638e36019e None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:12.076081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015d13-2ce6-47c1-a4b3-9a638e36019e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:12.076081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b015d13-2ce6-47c1-a4b3-9a638e36019e None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:12.077421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:12.082906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc3b7-0109-46a8-9806-2b81ecd812f6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:12.085972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc3b7-0109-46a8-9806-2b81ecd812f6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:12.085972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc3b7-0109-46a8-9806-2b81ecd812f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:12.150766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f96dc3b7-0109-46a8-9806-2b81ecd812f6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:12.151994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f96dc3b7-0109-46a8-9806-2b81ecd812f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:12.206800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:12.258136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:12.558259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b015d13-2ce6-47c1-a4b3-9a638e36019e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:12.559825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8b015d13-2ce6-47c1-a4b3-9a638e36019e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:12.704488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b015d13-2ce6-47c1-a4b3-9a638e36019e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:12.775763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:12.816141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:12.816748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:12.817028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:12.817302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:12.818952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:12.908244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:12.909862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e2870-9378-4964-80de-ae75f6f1896e service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:12.928522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 720/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:13.812491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c67d3c-27ac-4b69-b696-2ac039ee8e53 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:13.812965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c67d3c-27ac-4b69-b696-2ac039ee8e53 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:13.813063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c67d3c-27ac-4b69-b696-2ac039ee8e53 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:13.814503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:13.819387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d277f2-5ec0-4ea7-8654-114d1820f62c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:13.819849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d277f2-5ec0-4ea7-8654-114d1820f62c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:13.819951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d277f2-5ec0-4ea7-8654-114d1820f62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:13.895788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-24d277f2-5ec0-4ea7-8654-114d1820f62c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:13.897010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-24d277f2-5ec0-4ea7-8654-114d1820f62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:13.924509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:13.993544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:14.149323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c67d3c-27ac-4b69-b696-2ac039ee8e53 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:14.151090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-02c67d3c-27ac-4b69-b696-2ac039ee8e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:14.306154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c67d3c-27ac-4b69-b696-2ac039ee8e53 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:14.346014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:14.419294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:14.419817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:14.420092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:14.420357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:14.421954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:14.518554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:14.520157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886e4ef-afcd-40de-a2e2-2aab0d81c182 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:14.540195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 698/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:15.425549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7deff5-8abb-48a2-be98-31fba42a7f00 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:15.426106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7deff5-8abb-48a2-be98-31fba42a7f00 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:15.426106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7deff5-8abb-48a2-be98-31fba42a7f00 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:15.427486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:15.433121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c9b5b-0a93-46e3-9f24-342ae01cc9c3 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:15.433536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c9b5b-0a93-46e3-9f24-342ae01cc9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:15.433678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c9b5b-0a93-46e3-9f24-342ae01cc9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:15.488850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:15.511772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-189c9b5b-0a93-46e3-9f24-342ae01cc9c3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:15.512997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-189c9b5b-0a93-46e3-9f24-342ae01cc9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:15.610365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:15.761983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7deff5-8abb-48a2-be98-31fba42a7f00 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:15.763435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5d7deff5-8abb-48a2-be98-31fba42a7f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:15.909060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7deff5-8abb-48a2-be98-31fba42a7f00 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:15.921782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:16.023429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:16.023960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:16.024243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:16.024516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:16.026196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:16.118690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:16.120317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdaf6a-cbf4-4898-8cf3-53665e956f14 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:16.139536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 723/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:17.010662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9864-f338-453d-a8c1-05a8419ccff1 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:17.011228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9864-f338-453d-a8c1-05a8419ccff1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:17.011228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff9864-f338-453d-a8c1-05a8419ccff1 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:17.012541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:17.017592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05b7ae-6a4c-4549-94ed-8171c9e55560 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:17.018060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05b7ae-6a4c-4549-94ed-8171c9e55560 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:17.018172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05b7ae-6a4c-4549-94ed-8171c9e55560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:17.038269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:17.097112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9f05b7ae-6a4c-4549-94ed-8171c9e55560 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:17.098274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9f05b7ae-6a4c-4549-94ed-8171c9e55560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:17.199323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:17.356833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff9864-f338-453d-a8c1-05a8419ccff1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:17.358315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5cff9864-f338-453d-a8c1-05a8419ccff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:17.470172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:17.507282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff9864-f338-453d-a8c1-05a8419ccff1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:17.625603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:17.626163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:17.626441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:17.626709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:17.628303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:17.704856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:17.718503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:17.720113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78d1fd-3e09-4232-aefc-7161d78eee59 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:17.737848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 701/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:18.617006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d059733-fc78-46dc-8008-91764eefd7cf None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:18.617666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d059733-fc78-46dc-8008-91764eefd7cf None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:18.617666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d059733-fc78-46dc-8008-91764eefd7cf None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:18.618968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:18.624103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace468f-55dc-4f14-8930-f0d3c0dd751b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:18.624534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace468f-55dc-4f14-8930-f0d3c0dd751b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:18.624644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace468f-55dc-4f14-8930-f0d3c0dd751b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:18.703202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0ace468f-55dc-4f14-8930-f0d3c0dd751b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:18.704489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0ace468f-55dc-4f14-8930-f0d3c0dd751b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:18.801953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:18.961387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d059733-fc78-46dc-8008-91764eefd7cf None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:18.963546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0d059733-fc78-46dc-8008-91764eefd7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:19.068306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:19.129828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d059733-fc78-46dc-8008-91764eefd7cf None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:19.243971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:19.246516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:19.246516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:19.246516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:19.246792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:19.297115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:19.339695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:19.341209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9339a9-9e5f-451e-acdf-03b023779fec service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:19.359374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 726/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:20.257381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66eb8-42c2-4438-a7a1-299b54819d36 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:20.257969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66eb8-42c2-4438-a7a1-299b54819d36 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:20.257969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf66eb8-42c2-4438-a7a1-299b54819d36 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:20.259319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:20.264526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c09e-b129-40b8-8b79-fcdfbb1dbc95 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:20.264940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c09e-b129-40b8-8b79-fcdfbb1dbc95 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:20.265108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83c09e-b129-40b8-8b79-fcdfbb1dbc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:20.346203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0a83c09e-b129-40b8-8b79-fcdfbb1dbc95 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:20.347427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0a83c09e-b129-40b8-8b79-fcdfbb1dbc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:20.446759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:20.598750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66eb8-42c2-4438-a7a1-299b54819d36 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:20.600356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1cf66eb8-42c2-4438-a7a1-299b54819d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:20.649105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:20.745615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf66eb8-42c2-4438-a7a1-299b54819d36 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:20.858088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:20.858701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:20.858980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:20.859252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:20.860843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:20.868251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:20.948894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:20.950522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15071405-bc63-46c3-a7a7-6bb502208ead service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:20.968035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 704/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:21.824564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b28da-6125-4495-b2b7-eb980101d0f6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:21.836028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b28da-6125-4495-b2b7-eb980101d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:21.836028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b28da-6125-4495-b2b7-eb980101d0f6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:21.836028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:21.836355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b845d-cec4-4ddb-b0ae-ada48ab7e283 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:21.836355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b845d-cec4-4ddb-b0ae-ada48ab7e283 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:21.836355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b845d-cec4-4ddb-b0ae-ada48ab7e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:21.907632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-732b845d-cec4-4ddb-b0ae-ada48ab7e283 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:21.908841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-732b845d-cec4-4ddb-b0ae-ada48ab7e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:21.975953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:22.003593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:22.152149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b28da-6125-4495-b2b7-eb980101d0f6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:22.153641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-163b28da-6125-4495-b2b7-eb980101d0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:22.174260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:22.308329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b28da-6125-4495-b2b7-eb980101d0f6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:22.397597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:22.423391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:22.423918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:22.424195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:22.424464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:22.426087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:22.518818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:22.520836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9e5a6-1986-4098-a953-b8280070b20c service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:22.539191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 729/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:23.429995 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd09f3-2f3d-45ed-9926-bf8abbc332a4 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:23.430581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd09f3-2f3d-45ed-9926-bf8abbc332a4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:23.430581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd09f3-2f3d-45ed-9926-bf8abbc332a4 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:23.431886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:23.436802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23777b75-1851-4b7f-b30f-3f6b26fa08b6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:23.437207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23777b75-1851-4b7f-b30f-3f6b26fa08b6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:23.437358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23777b75-1851-4b7f-b30f-3f6b26fa08b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:23.516951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-23777b75-1851-4b7f-b30f-3f6b26fa08b6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:23.518252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-23777b75-1851-4b7f-b30f-3f6b26fa08b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:23.559663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:23.614395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:23.766667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd09f3-2f3d-45ed-9926-bf8abbc332a4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:23.768156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3cfd09f3-2f3d-45ed-9926-bf8abbc332a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:23.911818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd09f3-2f3d-45ed-9926-bf8abbc332a4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:23.973210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:24.031339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:24.031958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:24.032240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:24.032514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:24.034151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:24.123917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:24.125521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e255d77-6d1f-4d19-98cf-134891ebbc35 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:24.143926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 707/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:25.033669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d97c2a-f65e-4b4d-8468-c837c091d628 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:25.034278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d97c2a-f65e-4b4d-8468-c837c091d628 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:25.034278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d97c2a-f65e-4b4d-8468-c837c091d628 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:25.035671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:25.041359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28439d-26ed-40b0-aee2-067556293662 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:25.041812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28439d-26ed-40b0-aee2-067556293662 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:25.041929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28439d-26ed-40b0-aee2-067556293662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:25.119506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3b28439d-26ed-40b0-aee2-067556293662 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:25.120683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3b28439d-26ed-40b0-aee2-067556293662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:25.122745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:25.219110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:25.368592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d97c2a-f65e-4b4d-8468-c837c091d628 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:25.370066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f9d97c2a-f65e-4b4d-8468-c837c091d628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:25.517188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d97c2a-f65e-4b4d-8468-c837c091d628 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:25.544334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:25.629914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:25.630435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:25.630864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:25.631756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:25.633357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:25.720829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:25.722471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f26e37-74b6-447d-bc9f-fe9fb92b991a service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:25.741411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 732/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:27.598450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e939001-7921-42a6-a3c4-3c0192c4c8e0 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:27.599042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e939001-7921-42a6-a3c4-3c0192c4c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:27.599042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e939001-7921-42a6-a3c4-3c0192c4c8e0 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:27.600531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:27.606134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed89a24-8e01-4595-a058-197abdcc30d1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:27.606597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed89a24-8e01-4595-a058-197abdcc30d1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:27.606707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed89a24-8e01-4595-a058-197abdcc30d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:27.648048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:27.673075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0ed89a24-8e01-4595-a058-197abdcc30d1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:27.674425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0ed89a24-8e01-4595-a058-197abdcc30d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:27.777664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:28.073456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e939001-7921-42a6-a3c4-3c0192c4c8e0 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:28.075031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3e939001-7921-42a6-a3c4-3c0192c4c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:28.179007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e939001-7921-42a6-a3c4-3c0192c4c8e0 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:28.212058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:28.255758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:28.256368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:28.256649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:28.256928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:28.258579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:28.366882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:28.368239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe27c7d-d846-4af6-b4a7-388f6f59e3c4 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:28.386872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 710/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:30.621587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2473c9-8669-401d-bb75-654e4ff0b680 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:30.622181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2473c9-8669-401d-bb75-654e4ff0b680 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:30.622181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2473c9-8669-401d-bb75-654e4ff0b680 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:30.623537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:30.629688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a22ba-8ad2-47d6-aa7a-4f2d59d9af58 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:30.630116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a22ba-8ad2-47d6-aa7a-4f2d59d9af58 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:30.630304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a22ba-8ad2-47d6-aa7a-4f2d59d9af58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:30.697390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-422a22ba-8ad2-47d6-aa7a-4f2d59d9af58 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:30.698639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-422a22ba-8ad2-47d6-aa7a-4f2d59d9af58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:30.711849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:30.796130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:41:31.082324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2473c9-8669-401d-bb75-654e4ff0b680 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:31.089580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7e2473c9-8669-401d-bb75-654e4ff0b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:31.190024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2473c9-8669-401d-bb75-654e4ff0b680 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:31.203352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:31.264601 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:31.265207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:31.265481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:31.265747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:31.267378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:31.377068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:31.378476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cb9d8-3a76-420d-beb4-d2013ee97dfa service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:31.397261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 735/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:33.744589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1792d-06b7-4d31-bbac-5cf3abd59eba None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:33.745142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1792d-06b7-4d31-bbac-5cf3abd59eba None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:33.745142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c1792d-06b7-4d31-bbac-5cf3abd59eba None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:33.746430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:33.751886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a0cc-5ff1-4342-b545-a02d2cea4bfe None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:33.752280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a0cc-5ff1-4342-b545-a02d2cea4bfe None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:33.752431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0a0cc-5ff1-4342-b545-a02d2cea4bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:33.801051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:33.819645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a0c0a0cc-5ff1-4342-b545-a02d2cea4bfe None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:33.825674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a0c0a0cc-5ff1-4342-b545-a02d2cea4bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:33.915384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:34.204100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1792d-06b7-4d31-bbac-5cf3abd59eba None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:34.205826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-04c1792d-06b7-4d31-bbac-5cf3abd59eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.313389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c1792d-06b7-4d31-bbac-5cf3abd59eba None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:34.356863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:34.390064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:34.390677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:34.390960 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:34.391236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:34.393676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:34.507172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:34.508675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30520cb5-9b0b-4336-a5f8-5fad6cf7ff48 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:34.527692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 713/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:36.585146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46328-e96c-40fc-9436-bce2b5837ea4 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.585680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46328-e96c-40fc-9436-bce2b5837ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.585680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c46328-e96c-40fc-9436-bce2b5837ea4 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.587087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:36.592589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb1ae5-f717-4899-bf4e-cb2d26437a55 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:36.593011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb1ae5-f717-4899-bf4e-cb2d26437a55 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:36.593134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb1ae5-f717-4899-bf4e-cb2d26437a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:36.659533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-cadb1ae5-f717-4899-bf4e-cb2d26437a55 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:36.660763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cadb1ae5-f717-4899-bf4e-cb2d26437a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:36.682401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:36.760431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:37.045056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46328-e96c-40fc-9436-bce2b5837ea4 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:37.046723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-70c46328-e96c-40fc-9436-bce2b5837ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:37.159709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c46328-e96c-40fc-9436-bce2b5837ea4 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:37.180897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:37.235172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:37.235798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:37.236078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:37.236351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:37.238022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:37.353297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:37.354711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87b5a9-6aee-4ac6-92fb-4f2680c2846c service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:37.373225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 738/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:39.451663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a7fad-c44f-4955-b85e-621d99aca0af None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:39.452250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a7fad-c44f-4955-b85e-621d99aca0af None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:39.452862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a7fad-c44f-4955-b85e-621d99aca0af None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:39.454549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:39.460303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf0c7-54cb-4917-bb65-49f3bdd07ea0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:39.460796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf0c7-54cb-4917-bb65-49f3bdd07ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:39.460901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf0c7-54cb-4917-bb65-49f3bdd07ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:39.527612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:39.530284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fd7bf0c7-54cb-4917-bb65-49f3bdd07ea0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:39.531545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fd7bf0c7-54cb-4917-bb65-49f3bdd07ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:39.629481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:39.913261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a7fad-c44f-4955-b85e-621d99aca0af None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:39.914872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ce5a7fad-c44f-4955-b85e-621d99aca0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:40.021179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a7fad-c44f-4955-b85e-621d99aca0af None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:40.070831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:40.096572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:40.097206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:40.097487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:40.097759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:40.099983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:40.211196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:40.212645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd7a4b7-2f97-4311-ac8d-1756ff588d57 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:40.231060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 716/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:42.292447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fe20-10df-4368-9e02-bdae19f431b6 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.293085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fe20-10df-4368-9e02-bdae19f431b6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.293085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1643fe20-10df-4368-9e02-bdae19f431b6 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.294424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:42.299898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645873-ec75-4a64-a4f2-91d1dfbcb89a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.300333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645873-ec75-4a64-a4f2-91d1dfbcb89a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.300430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4645873-ec75-4a64-a4f2-91d1dfbcb89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.369567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e4645873-ec75-4a64-a4f2-91d1dfbcb89a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:42.370837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e4645873-ec75-4a64-a4f2-91d1dfbcb89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.401036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:42.473583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:42.758016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643fe20-10df-4368-9e02-bdae19f431b6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:42.759615 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1643fe20-10df-4368-9e02-bdae19f431b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:42.862856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1643fe20-10df-4368-9e02-bdae19f431b6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:42.891761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:42.938558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:42.939174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:42.939454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:42.939726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:42.941337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:43.050943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:43.052410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aac9f1-da82-49d2-8d9e-68938b0f4904 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:43.188857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 741/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:45.204849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599b7d-d4ce-49d3-bd61-5e9c11a0e73b None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:45.205434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599b7d-d4ce-49d3-bd61-5e9c11a0e73b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:45.205434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83599b7d-d4ce-49d3-bd61-5e9c11a0e73b None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:45.206836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:45.212191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0ee7-aceb-4c87-a55f-4410ef16f249 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:45.212629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0ee7-aceb-4c87-a55f-4410ef16f249 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:45.212760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b0ee7-aceb-4c87-a55f-4410ef16f249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:45.282991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-977b0ee7-aceb-4c87-a55f-4410ef16f249 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:45.284245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-977b0ee7-aceb-4c87-a55f-4410ef16f249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:45.293706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:45.389698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:45.690093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599b7d-d4ce-49d3-bd61-5e9c11a0e73b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:45.691723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-83599b7d-d4ce-49d3-bd61-5e9c11a0e73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:45.921035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83599b7d-d4ce-49d3-bd61-5e9c11a0e73b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:45.978026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:45.996042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:45.996656 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:45.996941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:45.997218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:45.998850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:46.111347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:46.112793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca7da8-b9e8-4748-b0d1-02846b12e3c9 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:46.132149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 719/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:48.085564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82826573-b24b-4300-83fd-819da5ebf227 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.086107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82826573-b24b-4300-83fd-819da5ebf227 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.086107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82826573-b24b-4300-83fd-819da5ebf227 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.087395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:48.092884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1e63-ef4f-4b10-a9d4-80e03631d797 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.093337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1e63-ef4f-4b10-a9d4-80e03631d797 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.093449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b1e63-ef4f-4b10-a9d4-80e03631d797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.160168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-de1b1e63-ef4f-4b10-a9d4-80e03631d797 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:48.161949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-de1b1e63-ef4f-4b10-a9d4-80e03631d797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:48.201692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:48.260476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:48.545962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82826573-b24b-4300-83fd-819da5ebf227 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:48.547527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-82826573-b24b-4300-83fd-819da5ebf227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:48.669341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82826573-b24b-4300-83fd-819da5ebf227 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:48.711612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:48.769587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:48.770168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:48.770450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:48.770754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:48.772439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:48.893894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:48.895404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47349649-1e9f-4f2c-aeca-5bbefaba5394 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:48.915697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 744/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:50.868507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99dba5-8a2d-420d-ade2-e760943e8580 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.869079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99dba5-8a2d-420d-ade2-e760943e8580 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.869206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99dba5-8a2d-420d-ade2-e760943e8580 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.870748 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:50.876289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a6d8-da9c-469f-aa80-4c96ade7fb34 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:50.876726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a6d8-da9c-469f-aa80-4c96ade7fb34 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:50.876851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a6d8-da9c-469f-aa80-4c96ade7fb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:50.943823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-48e5a6d8-da9c-469f-aa80-4c96ade7fb34 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:50.945032 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-48e5a6d8-da9c-469f-aa80-4c96ade7fb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:50.962672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:51.045713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:51.325357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99dba5-8a2d-420d-ade2-e760943e8580 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:51.326968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-aa99dba5-8a2d-420d-ade2-e760943e8580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:51.432224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99dba5-8a2d-420d-ade2-e760943e8580 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:51.499836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:51.506648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:51.515407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:51.515407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:51.515407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:51.515407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:51.617694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:51.619119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537fac17-2b06-4820-b688-8a1e8efe2aff service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:51.637099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 722/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:41:53.590391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08040dcb-cb95-4e65-8c5f-f3e1b373449c None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:53.591003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08040dcb-cb95-4e65-8c5f-f3e1b373449c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:53.591003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08040dcb-cb95-4e65-8c5f-f3e1b373449c None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.592302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:41:53.597840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007182-69ca-4d38-96e0-c8b46833b5b3 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:53.598278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007182-69ca-4d38-96e0-c8b46833b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:53.598378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75007182-69ca-4d38-96e0-c8b46833b5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:53.664072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-75007182-69ca-4d38-96e0-c8b46833b5b3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:41:53.665307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-75007182-69ca-4d38-96e0-c8b46833b5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:53.714230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:53.761723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:41:54.046941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08040dcb-cb95-4e65-8c5f-f3e1b373449c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:41:54.048521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-08040dcb-cb95-4e65-8c5f-f3e1b373449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:54.168383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08040dcb-cb95-4e65-8c5f-f3e1b373449c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:41:54.216562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:41:54.248066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:41:54.248764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:41:54.249089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:41:54.249357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:41:54.251454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:41:54.368314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:41:54.369708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bfff3-3d01-4132-b727-1947762c5eec service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:41:54.389084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 747/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:03.759984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=22 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:04.386763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=66 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:13.994722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e6385-c326-40b6-8348-ea56a2cb4f0f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:13.995305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e6385-c326-40b6-8348-ea56a2cb4f0f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:13.995305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e6385-c326-40b6-8348-ea56a2cb4f0f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:13.996640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 724/1471] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:14.001896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241425-6bdf-4616-b1b5-8e9d3c15a91b None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.002326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241425-6bdf-4616-b1b5-8e9d3c15a91b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.002443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36241425-6bdf-4616-b1b5-8e9d3c15a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.068248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-36241425-6bdf-4616-b1b5-8e9d3c15a91b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:14.069365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-36241425-6bdf-4616-b1b5-8e9d3c15a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.167344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 748/1472] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:14.466292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ecd5-f8a2-4516-8e72-e7bfe9e80e06 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.466578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ecd5-f8a2-4516-8e72-e7bfe9e80e06 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.466975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4ecd5-f8a2-4516-8e72-e7bfe9e80e06 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.468213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 725/1473] 10.222.0.40 () {54 vars in 967 bytes} [Wed Aug 24 03:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:14.473200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a379-a94a-49e0-9be7-4aee9001f94e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.473481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a379-a94a-49e0-9be7-4aee9001f94e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.473754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a379-a94a-49e0-9be7-4aee9001f94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.548748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-aa37a379-a94a-49e0-9be7-4aee9001f94e None None] MFA Rules not processed for user `fc5b05e5e96a4afc95ab176576b92577`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:14.549982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-aa37a379-a94a-49e0-9be7-4aee9001f94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.570366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:14.625484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 749/1474] 10.222.0.40 () {58 vars in 1064 bytes} [Wed Aug 24 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:14.633588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4ecd5-f8a2-4516-8e72-e7bfe9e80e06 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:14.635142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-73e4ecd5-f8a2-4516-8e72-e7bfe9e80e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.737854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4ecd5-f8a2-4516-8e72-e7bfe9e80e06 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:14.813474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:14.814143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:14.814965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:14.815255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:14.816859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:14.870049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:14.926308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:14.927689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c57e2-f125-44ca-93ed-ada73705c028 service glance] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:14.946568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 726/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:16.953316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e24ee-fae3-4dde-a5eb-07b688f91267 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.953900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e24ee-fae3-4dde-a5eb-07b688f91267 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.953900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e24ee-fae3-4dde-a5eb-07b688f91267 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:16.955875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 750/1476] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:16.961130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda458a-4549-4bdb-b45d-0d7555fcc4b2 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:16.961595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda458a-4549-4bdb-b45d-0d7555fcc4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:16.961699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda458a-4549-4bdb-b45d-0d7555fcc4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:17.031353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2dda458a-4549-4bdb-b45d-0d7555fcc4b2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:17.032570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2dda458a-4549-4bdb-b45d-0d7555fcc4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:17.143962 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 727/1477] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:17.413537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e24ee-fae3-4dde-a5eb-07b688f91267 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:17.415321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1a5e24ee-fae3-4dde-a5eb-07b688f91267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:17.541275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e24ee-fae3-4dde-a5eb-07b688f91267 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:17.590362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:17.638148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:17.638776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:17.639044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:17.639312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:17.639954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:17.641684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:42:17.641684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:42:17.641684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:42:17.642887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94d423-87fd-41b7-a4bc-ac8643be4606 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:17.662420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 751/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Aug 24 03:42:17 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:42:19.623804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f257-94ca-46e0-93e2-488033a1222f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:19.624368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f257-94ca-46e0-93e2-488033a1222f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:19.624368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669f257-94ca-46e0-93e2-488033a1222f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:19.625706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 728/1479] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:19.631699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ba7-7157-4d40-8b85-82e899e0cdba None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:19.632155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ba7-7157-4d40-8b85-82e899e0cdba None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:19.632266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b130ba7-7157-4d40-8b85-82e899e0cdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:19.697293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3b130ba7-7157-4d40-8b85-82e899e0cdba None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:19.698530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3b130ba7-7157-4d40-8b85-82e899e0cdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:19.792312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 752/1480] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:20.090180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669f257-94ca-46e0-93e2-488033a1222f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:20.091740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9669f257-94ca-46e0-93e2-488033a1222f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:20.101998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:20.239790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669f257-94ca-46e0-93e2-488033a1222f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:20.325261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:20.358914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:20.359423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:20.359704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:20.359978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:20.361626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:20.452978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:20.455320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e7a89-3a63-4767-8a22-0dbd7772c9b7 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:20.473625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 729/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:22.603936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7d61-bd94-46b7-98d6-5edd44ef5c20 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:22.604540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7d61-bd94-46b7-98d6-5edd44ef5c20 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:22.604540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7d61-bd94-46b7-98d6-5edd44ef5c20 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:22.605851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 753/1482] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:22.611204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263b2f-4550-4724-adb5-239a475692d5 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:22.611654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263b2f-4550-4724-adb5-239a475692d5 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:22.611763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4263b2f-4550-4724-adb5-239a475692d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:22.678875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b4263b2f-4550-4724-adb5-239a475692d5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:22.680083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b4263b2f-4550-4724-adb5-239a475692d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:22.726249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:22.776979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 730/1483] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:23.062335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7d61-bd94-46b7-98d6-5edd44ef5c20 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:23.064238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d5bc7d61-bd94-46b7-98d6-5edd44ef5c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:23.091245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:23.172342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7d61-bd94-46b7-98d6-5edd44ef5c20 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:23.245548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:23.246187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:23.246469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:23.246741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:23.248361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:23.322166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:23.362514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:23.363942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fdca6-ff0f-416e-af91-20208ad77326 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:23.382971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 754/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:25.388374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a415-f613-4067-8a47-0f57e0d7d81f None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:25.388969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a415-f613-4067-8a47-0f57e0d7d81f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:25.388969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a415-f613-4067-8a47-0f57e0d7d81f None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:25.390297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 731/1485] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:25.395650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bdb6f-b450-42c2-9482-d0ceac1ff520 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:25.396044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bdb6f-b450-42c2-9482-d0ceac1ff520 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:25.396202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bdb6f-b450-42c2-9482-d0ceac1ff520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:25.462514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ef6bdb6f-b450-42c2-9482-d0ceac1ff520 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:25.463740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ef6bdb6f-b450-42c2-9482-d0ceac1ff520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:25.564708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 755/1486] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:25.850812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a415-f613-4067-8a47-0f57e0d7d81f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:25.852353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e9b0a415-f613-4067-8a47-0f57e0d7d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:25.968219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a415-f613-4067-8a47-0f57e0d7d81f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:26.041292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:26.043188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:26.043795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:26.044077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:26.044349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:26.046004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:26.156826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:26.158785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9701b00-78c5-43aa-9307-8686a35bdad9 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:26.176975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 732/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:28.195008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2be25-2ff3-4c65-a227-81e048c61db3 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:28.195548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2be25-2ff3-4c65-a227-81e048c61db3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:28.195548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2be25-2ff3-4c65-a227-81e048c61db3 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:28.196848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 756/1488] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:28.202031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b99a9-4e90-4143-93a6-c44fc9892486 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:28.202440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b99a9-4e90-4143-93a6-c44fc9892486 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:28.202582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b99a9-4e90-4143-93a6-c44fc9892486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:28.269818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2b8b99a9-4e90-4143-93a6-c44fc9892486 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:28.271034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2b8b99a9-4e90-4143-93a6-c44fc9892486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:28.323916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.368500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 733/1489] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:28.659698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2be25-2ff3-4c65-a227-81e048c61db3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:28.661253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1ce2be25-2ff3-4c65-a227-81e048c61db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:28.699159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.767017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2be25-2ff3-4c65-a227-81e048c61db3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:28.839338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:28.839950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:28.840229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:28.840527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:28.842175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:28.921275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:28.949718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:28.951187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f0277-d652-4007-85d6-9480ac1f4d5f service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:28.969160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 757/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:31.325116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0abbf-d6b9-4b3f-854b-76249cbbfe6e None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.325714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0abbf-d6b9-4b3f-854b-76249cbbfe6e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.325714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0abbf-d6b9-4b3f-854b-76249cbbfe6e None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.327083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 734/1491] 10.222.0.40 () {54 vars in 927 bytes} [Wed Aug 24 03:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:42:31.333044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c4309-61ca-4213-b14d-a5d1acb81d44 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.333537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c4309-61ca-4213-b14d-a5d1acb81d44 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.333794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408c4309-61ca-4213-b14d-a5d1acb81d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.401898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-408c4309-61ca-4213-b14d-a5d1acb81d44 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:42:31.403127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-408c4309-61ca-4213-b14d-a5d1acb81d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:31.499534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 758/1492] 10.222.0.40 () {58 vars in 1024 bytes} [Wed Aug 24 03:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:42:31.786246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0abbf-d6b9-4b3f-854b-76249cbbfe6e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:42:31.788047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6fd0abbf-d6b9-4b3f-854b-76249cbbfe6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:31.890122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0abbf-d6b9-4b3f-854b-76249cbbfe6e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:42:31.962093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:42:31.962700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:42:31.962979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:42:31.963251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:42:31.964829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:42:31.974327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:32.073725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:42:32.075107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec2fef-67b9-4092-ae67-1c413407b66c service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:42:32.093456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 735/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:42:41.497760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=82 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:42:42.091295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=50 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:56.077041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:56.077639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:56.077639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:56.162572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:56.162572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:56.256812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 759/1494] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:56.265926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:56.266435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:56.266544 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:56.343640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:56.344872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:56.440611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 736/1495] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:56.445279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:56.447065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:56.458651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9288a31-476a-4d28-8330-2fe347a16e54 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:56.520199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:56.554747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:56.555356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:56.555707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:56.555897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:56.556556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:43:56.556853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:56.557912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:56.557912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:43:56.557912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:43:56.558789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:56.571993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 760/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:43:56.580532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:56.590577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674d68b-ccdc-4307-a97b-535b49d9f08c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:56.651229 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:56.685034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:56.685632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:56.685941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:56.686209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:56.686826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:56.688549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:56.688549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:43:56.688549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:43:56.689741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:56.826788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 737/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:43:56 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:56.831556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:56.832597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:56.866567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c090b8f-f0f9-4eb7-9b16-9535bfc1c63c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:56.961569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:56.962811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:56.963098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:56.963385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:56.964024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:56.965034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:56.965034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:43:56.965034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:43:56.966282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:57.118090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 761/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:43:56 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:43:57.122130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:57.123662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:57.191067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2142f-c924-468d-a401-e8c3311ca9ca admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:57.293751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:57.304122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:57.304732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:57.305011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:57.305278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:57.305964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:57.306970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:57.306970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:43:57.306970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:43:57.307852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:57.322520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 738/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:57.326882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:57.328446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:57.340596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d690eb5-5c0a-43f7-b98f-60b3f73086c0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:57.370645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:57.442720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:57.443332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:57.443606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:57.443875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:57.444510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:57.445507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:57.445507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:43:57.445507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:43:57.446941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774bd892-e36e-4b44-b85e-b6bb2e5487e9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:57.459850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 762/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:43:57.464763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:57.466371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:57.506410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ced59-fed2-4696-be87-e3458a0a30c6 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:57.606776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77645688-241f-4138-8083-bd731b582cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:57.607447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645688-241f-4138-8083-bd731b582cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:57.607727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645688-241f-4138-8083-bd731b582cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:57.608015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77645688-241f-4138-8083-bd731b582cff admin admin] PATH_INFO: `/v3/projects/07e368eb40504419913e89318b9bf34e/users/9bebc7e1d1044c598b535c8c89709d43/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:57.632410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645688-241f-4138-8083-bd731b582cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e368eb40504419913e89318b9bf34e, user_id=9bebc7e1d1044c598b535c8c89709d43, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:57.633422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-77645688-241f-4138-8083-bd731b582cff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:57.633422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:43:57.633422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:43:57.636231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77645688-241f-4138-8083-bd731b582cff admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:57.769708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 739/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:43:57 2022] PUT /identity/v3/projects/07e368eb40504419913e89318b9bf34e/users/9bebc7e1d1044c598b535c8c89709d43/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:57.782855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144152f-e506-4313-8f09-29795ee0c93a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:57.782855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144152f-e506-4313-8f09-29795ee0c93a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:57.782855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144152f-e506-4313-8f09-29795ee0c93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:57.855852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c144152f-e506-4313-8f09-29795ee0c93a None None] MFA Rules not processed for user `9bebc7e1d1044c598b535c8c89709d43`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:57.857095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c144152f-e506-4313-8f09-29795ee0c93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:57.954286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 763/1502] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:43:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:43:57.968271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fd71c-67e3-4576-b0c2-6ac6e4dee0db None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:57.968553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fd71c-67e3-4576-b0c2-6ac6e4dee0db None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:57.968824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fd71c-67e3-4576-b0c2-6ac6e4dee0db None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:57.970198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 740/1503] 10.222.0.40 () {54 vars in 964 bytes} [Wed Aug 24 03:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:43:57.975415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b95a-fdcf-4734-bb16-db59f996c2b4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:57.981423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b95a-fdcf-4734-bb16-db59f996c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:57.981423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8b95a-fdcf-4734-bb16-db59f996c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:58.012025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:58.060535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2bf8b95a-fdcf-4734-bb16-db59f996c2b4 None None] MFA Rules not processed for user `db35ea7cc80d49caa8187dcde2d55642`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:58.061861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2bf8b95a-fdcf-4734-bb16-db59f996c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:58.140400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 764/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Aug 24 03:43:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:58.148188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fd71c-67e3-4576-b0c2-6ac6e4dee0db None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:58.150301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4e4fd71c-67e3-4576-b0c2-6ac6e4dee0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:58.207926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:58.261217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fd71c-67e3-4576-b0c2-6ac6e4dee0db None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:58.335470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:58.336169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:58.336343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:58.336622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:58.338772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:58.441428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:58.442906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:58.446957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:58.461241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 741/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:43:58.506274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04cd0-9943-4fae-9884-f752609422d1 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:58.506560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04cd0-9943-4fae-9884-f752609422d1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:58.506835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa04cd0-9943-4fae-9884-f752609422d1 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:58.508084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 765/1506] 10.222.0.40 () {52 vars in 830 bytes} [Wed Aug 24 03:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:43:58.512246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:58.513472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:58.613160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffd054-e7cb-4f41-a8d6-cbd16e63380e service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:58.707970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:58.708598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:58.708969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:58.709217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] PATH_INFO: `/v3/users/9bebc7e1d1044c598b535c8c89709d43` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:58.722629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bebc7e1d1044c598b535c8c89709d43)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:58.723596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:43:58.723596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:43:58.723596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:43:58.724804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:58.734623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:58.965910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bebc7e1d1044c598b535c8c89709d43'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:58.966455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bebc7e1d1044c598b535c8c89709d43'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:58.966883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bebc7e1d1044c598b535c8c89709d43'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:58.990022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bebc7e1d1044c598b535c8c89709d43'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:59.104199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bebc7e1d1044c598b535c8c89709d43'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:43:59.126129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 742/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:43:58 2022] DELETE /identity/v3/users/9bebc7e1d1044c598b535c8c89709d43 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:43:59.130503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:59.132873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:59.132873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:59.216900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:43:59.218183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:59.298147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:59.310996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 766/1508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:43:59.320618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:43:59.333494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:59.427465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61df6a-5ad9-40ec-acbc-f9b79b5d0218 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:43:59.485620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:43:59.504290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:43:59.504837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:43:59.505125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:43:59.505400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:43:59.507037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:43:59.622338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:43:59.623779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbd318-a3d2-4293-93ed-5d8170425013 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:43:59.642594 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 743/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:44:00.129351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:44:00.130894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:44:00.144592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472247a-d729-44d4-ab27-a1b72675dbaf None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:44:00.257068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:44:00.258325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:44:00.259138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:44:00.259417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] PATH_INFO: `/v3/projects/07e368eb40504419913e89318b9bf34e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:44:00.270124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e368eb40504419913e89318b9bf34e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:44:00.271167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:44:00.271167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:44:00.271167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:44:00.272376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:44:00.390202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e368eb40504419913e89318b9bf34e', 'request_id': 'req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:00.404020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e368eb40504419913e89318b9bf34e', 'request_id': 'req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:00.498532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e368eb40504419913e89318b9bf34e', 'request_id': 'req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:00.522683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] The token cache is being invalidate because project 07e368eb40504419913e89318b9bf34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:44:00.522979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:00.523513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44808b3c-8a1c-4bfa-9fc8-ece26acecacc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:44:00.525499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 767/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:44:00 2022] DELETE /identity/v3/projects/07e368eb40504419913e89318b9bf34e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:44:09.854080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=62 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:44:10.520663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:41.409547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5367-d162-4fc5-ba17-85ed1fbcaf05 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:41.410209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5367-d162-4fc5-ba17-85ed1fbcaf05 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:41.410209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c5367-d162-4fc5-ba17-85ed1fbcaf05 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:41.411563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:45:41.416623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac04a-53fe-4ebe-ac77-83ff2652578c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:41.417056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac04a-53fe-4ebe-ac77-83ff2652578c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:41.417275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ac04a-53fe-4ebe-ac77-83ff2652578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:41.502242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-312ac04a-53fe-4ebe-ac77-83ff2652578c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:41.503505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-312ac04a-53fe-4ebe-ac77-83ff2652578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:41.606980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:45:41.762518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5367-d162-4fc5-ba17-85ed1fbcaf05 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:45:41.764604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3a4c5367-d162-4fc5-ba17-85ed1fbcaf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:41.884232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c5367-d162-4fc5-ba17-85ed1fbcaf05 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:45:41.889748 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c753d-5d1c-441d-a1b1-edc20167daaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:45:41.890386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c753d-5d1c-441d-a1b1-edc20167daaa service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:41.890671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c753d-5d1c-441d-a1b1-edc20167daaa service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:41.890942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c753d-5d1c-441d-a1b1-edc20167daaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:41.899351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c753d-5d1c-441d-a1b1-edc20167daaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:45:41.900933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c753d-5d1c-441d-a1b1-edc20167daaa service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:45:41.910256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 745/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:42.534550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5657d-add9-41f6-9170-cd4966098c9e None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:42.667530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5657d-add9-41f6-9170-cd4966098c9e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:42.667530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5657d-add9-41f6-9170-cd4966098c9e None None] PATH_INFO: `/v3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:42.667530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 769/1514] 10.222.0.95 () {54 vars in 925 bytes} [Wed Aug 24 03:45:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:45:42.667873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bb55d-542c-45f4-a3ff-2ef2c16751a4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:42.667873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bb55d-542c-45f4-a3ff-2ef2c16751a4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:42.667873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bb55d-542c-45f4-a3ff-2ef2c16751a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:42.667873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e88bb55d-542c-45f4-a3ff-2ef2c16751a4 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:42.667873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e88bb55d-542c-45f4-a3ff-2ef2c16751a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:42.697935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:45:42.703344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 746/1515] 10.222.0.95 () {58 vars in 1015 bytes} [Wed Aug 24 03:45:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:45:42.751184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680997c6-3f1b-427e-88b9-a68123186ba8 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:42.751390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680997c6-3f1b-427e-88b9-a68123186ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:42.751651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680997c6-3f1b-427e-88b9-a68123186ba8 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:42.753043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 770/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:45:42.758780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052045cb-f6a3-47b2-9fe6-70851ef1231e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:42.759070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052045cb-f6a3-47b2-9fe6-70851ef1231e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:42.759342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052045cb-f6a3-47b2-9fe6-70851ef1231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:42.780561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-052045cb-f6a3-47b2-9fe6-70851ef1231e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:42.782373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-052045cb-f6a3-47b2-9fe6-70851ef1231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:42.789902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 747/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:45:42.942352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680997c6-3f1b-427e-88b9-a68123186ba8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:45:42.957485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680997c6-3f1b-427e-88b9-a68123186ba8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:45:42.963024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47412850-9038-414a-b851-6bd79ff68c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:45:42.963624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412850-9038-414a-b851-6bd79ff68c78 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:42.963902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412850-9038-414a-b851-6bd79ff68c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:42.964178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47412850-9038-414a-b851-6bd79ff68c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:42.972208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47412850-9038-414a-b851-6bd79ff68c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:45:42.973812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47412850-9038-414a-b851-6bd79ff68c78 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:45:42.983362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 771/1518] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:52.214682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4949-13eb-46b4-b394-0fd140251c34 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:52.215273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4949-13eb-46b4-b394-0fd140251c34 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:52.215273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c4949-13eb-46b4-b394-0fd140251c34 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:52.216504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 748/1519] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 24 03:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:45:52.221464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3ea84-f48b-4059-992b-18015d563575 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:52.221952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3ea84-f48b-4059-992b-18015d563575 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:52.222065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3ea84-f48b-4059-992b-18015d563575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:52.241204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c3e3ea84-f48b-4059-992b-18015d563575 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:52.242757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c3e3ea84-f48b-4059-992b-18015d563575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:52.252192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 772/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 24 03:45:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:45:52.259811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4949-13eb-46b4-b394-0fd140251c34 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:45:52.273921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c4949-13eb-46b4-b394-0fd140251c34 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:45:52.278802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d87879-5b94-407b-8435-00a1548dfe12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:45:52.279407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87879-5b94-407b-8435-00a1548dfe12 service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:52.279686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87879-5b94-407b-8435-00a1548dfe12 service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:52.279956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d87879-5b94-407b-8435-00a1548dfe12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:52.288689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d87879-5b94-407b-8435-00a1548dfe12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:45:52.290285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d87879-5b94-407b-8435-00a1548dfe12 service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:45:52.299950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 749/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:45:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:54.246626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c24eee-de8d-4781-a52e-b1077f535e17 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:54.247225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c24eee-de8d-4781-a52e-b1077f535e17 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:54.247225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c24eee-de8d-4781-a52e-b1077f535e17 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:54.248482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:45:54.253387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff962d7-0388-43f8-9420-3bd37446d629 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:54.253870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff962d7-0388-43f8-9420-3bd37446d629 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:54.253988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff962d7-0388-43f8-9420-3bd37446d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:54.273937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6ff962d7-0388-43f8-9420-3bd37446d629 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:54.275141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6ff962d7-0388-43f8-9420-3bd37446d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:54.283592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:45:54.438083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c24eee-de8d-4781-a52e-b1077f535e17 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:45:54.453378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c24eee-de8d-4781-a52e-b1077f535e17 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:45:54.458955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443fd12-e6cc-47cf-9da0-05f734ca650c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:45:54.459564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443fd12-e6cc-47cf-9da0-05f734ca650c service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:54.459845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443fd12-e6cc-47cf-9da0-05f734ca650c service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:54.460117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443fd12-e6cc-47cf-9da0-05f734ca650c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:54.469213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443fd12-e6cc-47cf-9da0-05f734ca650c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:45:54.470916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443fd12-e6cc-47cf-9da0-05f734ca650c service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:45:54.480714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 774/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:55.314763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b79b-66a9-43de-bcaf-fd3d9a125588 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:55.315358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b79b-66a9-43de-bcaf-fd3d9a125588 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:55.315358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0b79b-66a9-43de-bcaf-fd3d9a125588 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:55.316719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 03:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:45:55.321650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339958f-f865-4941-bebb-7b3a2256d222 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:55.322095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339958f-f865-4941-bebb-7b3a2256d222 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:55.322211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339958f-f865-4941-bebb-7b3a2256d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:55.342273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-1339958f-f865-4941-bebb-7b3a2256d222 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:55.343502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1339958f-f865-4941-bebb-7b3a2256d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:55.351531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 03:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:45:55.515887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b79b-66a9-43de-bcaf-fd3d9a125588 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:45:55.530931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0b79b-66a9-43de-bcaf-fd3d9a125588 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:45:55.537149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbd0b3-074d-46ac-8ef2-a30d70a3c855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:45:55.537819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd0b3-074d-46ac-8ef2-a30d70a3c855 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:55.538103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd0b3-074d-46ac-8ef2-a30d70a3c855 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:55.538398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbd0b3-074d-46ac-8ef2-a30d70a3c855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:55.548103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbd0b3-074d-46ac-8ef2-a30d70a3c855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:45:55.549814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbd0b3-074d-46ac-8ef2-a30d70a3c855 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:45:55.560569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 752/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:45:59.643045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26444f-b063-456d-9c0e-c0de8210e422 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:59.643715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26444f-b063-456d-9c0e-c0de8210e422 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:59.643715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26444f-b063-456d-9c0e-c0de8210e422 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:59.644936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:45:59.650809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa5aa-da50-4735-9368-3be4b47c2514 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:45:59.651260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa5aa-da50-4735-9368-3be4b47c2514 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:45:59.651375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aa5aa-da50-4735-9368-3be4b47c2514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:45:59.671503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-584aa5aa-da50-4735-9368-3be4b47c2514 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:45:59.672726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-584aa5aa-da50-4735-9368-3be4b47c2514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:45:59.680863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:45:59.964074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26444f-b063-456d-9c0e-c0de8210e422 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:45:59.966557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2b26444f-b063-456d-9c0e-c0de8210e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:00.003981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:00.053916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26444f-b063-456d-9c0e-c0de8210e422 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:00.058320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb4abc-d257-48d5-818c-be598d5fc6cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:00.058943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4abc-d257-48d5-818c-be598d5fc6cc service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:00.059227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4abc-d257-48d5-818c-be598d5fc6cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:00.059499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb4abc-d257-48d5-818c-be598d5fc6cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:00.069451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4abc-d257-48d5-818c-be598d5fc6cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:00.070944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb4abc-d257-48d5-818c-be598d5fc6cc service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:00.081059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 777/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:01.987577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f248-3423-4cc8-a33c-7d91d59de749 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:01.988131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f248-3423-4cc8-a33c-7d91d59de749 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:01.988251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1f248-3423-4cc8-a33c-7d91d59de749 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:01.989573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:01.995067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91e78-77d7-4c9b-9f51-4d78d65d6012 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:01.995543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91e78-77d7-4c9b-9f51-4d78d65d6012 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:01.995652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91e78-77d7-4c9b-9f51-4d78d65d6012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:02.015265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-83d91e78-77d7-4c9b-9f51-4d78d65d6012 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:02.016466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-83d91e78-77d7-4c9b-9f51-4d78d65d6012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:02.024489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:02.316582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f248-3423-4cc8-a33c-7d91d59de749 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:02.328110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1f248-3423-4cc8-a33c-7d91d59de749 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:02.331635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0fa49-298a-4d81-ae17-4069f78648e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:02.332236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fa49-298a-4d81-ae17-4069f78648e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:02.332520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fa49-298a-4d81-ae17-4069f78648e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:02.332795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0fa49-298a-4d81-ae17-4069f78648e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:02.342161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0fa49-298a-4d81-ae17-4069f78648e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:02.343638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0fa49-298a-4d81-ae17-4069f78648e7 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:02.353340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 755/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:05.846066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6fd70-ae93-44bd-ad04-3892771c4e25 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:05.846642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6fd70-ae93-44bd-ad04-3892771c4e25 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:05.846642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6fd70-ae93-44bd-ad04-3892771c4e25 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:05.847982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:05.853728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eeba3-e826-468d-8e88-d214d18f8d07 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:05.854197 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eeba3-e826-468d-8e88-d214d18f8d07 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:05.854309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eeba3-e826-468d-8e88-d214d18f8d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:05.874635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a25eeba3-e826-468d-8e88-d214d18f8d07 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:05.875858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a25eeba3-e826-468d-8e88-d214d18f8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:05.884227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:06.437055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6fd70-ae93-44bd-ad04-3892771c4e25 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:06.438811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a2e6fd70-ae93-44bd-ad04-3892771c4e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:06.518891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6fd70-ae93-44bd-ad04-3892771c4e25 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:06.523087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802fc65-bce0-4566-a8c3-8e177e8b1b51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:06.523700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fc65-bce0-4566-a8c3-8e177e8b1b51 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:06.523978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fc65-bce0-4566-a8c3-8e177e8b1b51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:06.524250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802fc65-bce0-4566-a8c3-8e177e8b1b51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:06.533389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802fc65-bce0-4566-a8c3-8e177e8b1b51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:06.534833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802fc65-bce0-4566-a8c3-8e177e8b1b51 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:06.544649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 780/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:46:08.485096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56a05-2139-4d04-8ba1-6e67d4ee15d3 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:08.485577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56a05-2139-4d04-8ba1-6e67d4ee15d3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:08.485684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c56a05-2139-4d04-8ba1-6e67d4ee15d3 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:08.487068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 03:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:46:08.492647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21e55-c412-471c-b428-d19513f430d4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:08.493203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21e55-c412-471c-b428-d19513f430d4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:08.493203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21e55-c412-471c-b428-d19513f430d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:08.513226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b6e21e55-c412-471c-b428-d19513f430d4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:46:08.514477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b6e21e55-c412-471c-b428-d19513f430d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:08.522604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 03:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:46:09.079666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56a05-2139-4d04-8ba1-6e67d4ee15d3 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:46:09.081355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d9c56a05-2139-4d04-8ba1-6e67d4ee15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:46:09.095038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c56a05-2139-4d04-8ba1-6e67d4ee15d3 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:46:09.098572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0df9f-6701-4030-ad2f-d21f617b26b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:46:09.099176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0df9f-6701-4030-ad2f-d21f617b26b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:46:09.099457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0df9f-6701-4030-ad2f-d21f617b26b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:46:09.099730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0df9f-6701-4030-ad2f-d21f617b26b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:46:09.109423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0df9f-6701-4030-ad2f-d21f617b26b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:46:09.110885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0df9f-6701-4030-ad2f-d21f617b26b1 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:46:09.120301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 758/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:46:18.508325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=63 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:46:19.116243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=37 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:43.615259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.616315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.616315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.647056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:43.648799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.670456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 782/1540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:43.679891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.680487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.680487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.719280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:43.720562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.730038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 759/1541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:43.735496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.746994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac88f9-4616-4453-ad37-7df375cd9af3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.761497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.770173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.770173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.770173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.770173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:43.770173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.770173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf9a88-b220-48a4-8964-8a746dd28de9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.783540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 783/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:43.793457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.808179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf1bbb-d90e-4e90-b81a-3efa2f42ad47 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:43.814243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:43.814900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.815849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.816131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.816793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:43.818805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:43.826821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5b64c-5999-472a-87c2-e08e1b5be9a4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.826821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5b64c-5999-472a-87c2-e08e1b5be9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.826821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5b64c-5999-472a-87c2-e08e1b5be9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.867668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-20e5b64c-5999-472a-87c2-e08e1b5be9a4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:43.869629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-20e5b64c-5999-472a-87c2-e08e1b5be9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.879668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 784/1543] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:43.890009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:43.890366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:43.890582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:43.921341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:43.922613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:43.937803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 785/1544] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:47:43.945839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.949130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 760/1545] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/projects => generated 363 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:43.952121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:43.961206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13afaa-3df4-42cc-aee9-4b5b288ee75a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.074731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.075376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.075652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.075922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.076577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.076879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.078522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e6068-7f07-47a4-972b-069af3163ed5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.104490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 786/1546] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:47:44.111047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3baf-72f4-410f-b530-3ca907ed4ff7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.111340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3baf-72f4-410f-b530-3ca907ed4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.111618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a3baf-72f4-410f-b530-3ca907ed4ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.123049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482d9f-4e1e-4b1e-b46d-fa363a719ef0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.147867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b96a3baf-72f4-410f-b530-3ca907ed4ff7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.149115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b96a3baf-72f4-410f-b530-3ca907ed4ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.163151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 787/1547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.164230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.164424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.164698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.164866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.164977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.165150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.165432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.166350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.167385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:44.167385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:47:44.167385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:47:44.168615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5333fd-7699-47e9-b7fd-c4c0ce6cf9d8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.206418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.207645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.216194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 788/1548] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.217456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.228309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368906f8-e077-4659-b035-4cf682dcd415 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.231837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.232499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.232778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.233049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.234053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.235056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:44.235056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:47:44.235056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:47:44.236416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca683e-ad30-42d7-aa3d-ac8fad5cdb75 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.278585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 761/1549] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:43 2022] POST /identity/v3/users => generated 282 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:44.280136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47d82-0924-44b1-8371-6202308f2312 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.280427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47d82-0924-44b1-8371-6202308f2312 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.280706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47d82-0924-44b1-8371-6202308f2312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.300940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6dc47d82-0924-44b1-8371-6202308f2312 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.302275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6dc47d82-0924-44b1-8371-6202308f2312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.310475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 762/1550] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.311658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9aa8f-228c-49fb-9ad4-028a2c68e2b1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.311959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9aa8f-228c-49fb-9ad4-028a2c68e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.312211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9aa8f-228c-49fb-9ad4-028a2c68e2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.332200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2ef9aa8f-228c-49fb-9ad4-028a2c68e2b1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.333419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2ef9aa8f-228c-49fb-9ad4-028a2c68e2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.338969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 789/1551] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:44.343118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 763/1552] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.343358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223af17-3152-4193-ba20-e24ef078a706 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.343644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223af17-3152-4193-ba20-e24ef078a706 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.343914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223af17-3152-4193-ba20-e24ef078a706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.345073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245931c4-a43f-4d82-b0d7-f7c67d879518 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.345601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245931c4-a43f-4d82-b0d7-f7c67d879518 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.346010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245931c4-a43f-4d82-b0d7-f7c67d879518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.366239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-245931c4-a43f-4d82-b0d7-f7c67d879518 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.372897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-245931c4-a43f-4d82-b0d7-f7c67d879518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.373010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e223af17-3152-4193-ba20-e24ef078a706 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.373010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e223af17-3152-4193-ba20-e24ef078a706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.432935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 764/1553] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.434409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.434801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.435233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.438107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 790/1554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.439279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcb73e-76a9-435e-a9d8-be3d90071956 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.439567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcb73e-76a9-435e-a9d8-be3d90071956 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.439839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dcb73e-76a9-435e-a9d8-be3d90071956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.456518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.457746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.462344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-24dcb73e-76a9-435e-a9d8-be3d90071956 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.463725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-24dcb73e-76a9-435e-a9d8-be3d90071956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.466017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 765/1555] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.469445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.479991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 791/1556] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.481280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.481587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.481877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.483699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f17d4-ec5c-4ba4-a6f3-15324c8b868b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.489349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.490000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.490546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.490831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.492430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.494074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.502414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.504170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.505565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 766/1557] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:44.505983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.513277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 792/1558] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.514521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.519309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b391d-0ed9-43ac-a1c5-70990f2a2526 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.524109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3942a-d790-4ffa-8e2d-eebfde4edb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.524280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23536aa9-0c90-4947-8dbc-ffcee2857304 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.524711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3942a-d790-4ffa-8e2d-eebfde4edb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.524996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3942a-d790-4ffa-8e2d-eebfde4edb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.525273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3942a-d790-4ffa-8e2d-eebfde4edb45 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.525939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3942a-d790-4ffa-8e2d-eebfde4edb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.527895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3942a-d790-4ffa-8e2d-eebfde4edb45 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.529095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.529638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.529951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.530225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.530862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.531163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.532722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.542479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:44.550194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 793/1559] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:44.550194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.556773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571f81f-c292-4bdc-8fe2-6ab95cce881d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.561289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.561917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.562194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.562460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.563087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.563387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.564953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8607d6a-77a9-4028-83d1-33a7e8e7fbf6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.576928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 794/1560] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:44.578315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b99c4-8ddd-4e8f-80d3-631b30e0a2a0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.578598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b99c4-8ddd-4e8f-80d3-631b30e0a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.578872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b99c4-8ddd-4e8f-80d3-631b30e0a2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.598271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2e7b99c4-8ddd-4e8f-80d3-631b30e0a2a0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.599466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2e7b99c4-8ddd-4e8f-80d3-631b30e0a2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.607240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 795/1561] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.608500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.608786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.609057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.628168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.634814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 767/1562] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:44.634946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.635047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.635047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.635047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.637965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 796/1563] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.639128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.642978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:44.648736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a3ebf-8ac3-4a30-9bf5-cdb180abbe95 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.653333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.653959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.654097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:44.654252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.654500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.655138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.655515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:44.656709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.664148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 768/1564] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:44.664961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.670786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 797/1565] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:44.670786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.675211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3b6e6-491a-4942-984d-25350453e208 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.679875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.680518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.681104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.681216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64422abf-d90c-4c65-91a0-d1df181a38ee admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.681318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.681787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.686289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.686289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:44.686289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:47:44.686289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:47:44.686289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.686667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.686667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.686667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.686914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.687402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.689272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.702931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 769/1566] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:44.702931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.707921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1df6-1ddc-46e4-a02c-fe674bcac41a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.712789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.713391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.713711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.714040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.714650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.716610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.778536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 798/1567] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:44.779517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.805746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 770/1568] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:44.805746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.842305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339771b3-6844-420c-9c5d-d7b4b9092ef3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.868264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbe018-d05c-4f3c-89dc-83d97c738868 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.872940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.873548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.873863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.874141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.874786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.876382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.886278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 771/1569] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:44.887104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.896788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32108b3f-ddce-47b4-abf9-7fc1500cc262 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.900605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.901222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.901359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.901486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.901785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.901921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.902203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.902440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.902549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.902746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.903088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.903392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.904375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.904956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.923616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 799/1570] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:44.923616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.923934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 772/1571] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:44.923934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.929082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d306-600c-4dc1-a39a-821182af8a1b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.933850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.934466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.934744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.935022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.935444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46efc0-1d9b-44f3-b649-9c7736f09218 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.935724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:47:44.936011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.938743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.940658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.941335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.941601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.941982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] PATH_INFO: `/v3/projects/78268c610838407c964c5b0e1ff2a828/users/88e1b72c30c84c50b4c19f62c5ad0c0b/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.949911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 800/1572] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:47:44.950834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:44.959650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78268c610838407c964c5b0e1ff2a828, user_id=88e1b72c30c84c50b4c19f62c5ad0c0b, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.961257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73e042-ff23-4a85-ab69-f1099fc34fa0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:44.962358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:44.966071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:44.966677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:44.966976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:44.967231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:44.967850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:44.969738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.057384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 773/1573] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:44 2022] PUT /identity/v3/projects/78268c610838407c964c5b0e1ff2a828/users/88e1b72c30c84c50b4c19f62c5ad0c0b/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:45.058174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.087879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 801/1574] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:44 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.089926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.098703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.122846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e133878-1a13-4028-bb9f-fe29936b77d3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.150885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.154841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b837e80-7eff-458b-9bff-c498447f9815 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.160158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.160767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.161043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.161308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.161957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.163860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.181634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.182285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.182567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.182841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.183495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.185430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.310409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 802/1575] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.310409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.320175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ff9a1-871c-4888-b1aa-06caea4e996b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.325068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.325715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.326067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.326343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.326979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.328583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.342580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 803/1576] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:45.343576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.353893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6ebbe-da59-4eca-aa2a-2cb358e7204e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.357902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 774/1577] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.357902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.360397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.361014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.361304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.361563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.362215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.364208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.366698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9a7a4-ef5a-44eb-81e3-1bc623b1af8e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.371688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63342a-f68c-49b8-a7ae-84418630c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.372340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63342a-f68c-49b8-a7ae-84418630c63f admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.372584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63342a-f68c-49b8-a7ae-84418630c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.372860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63342a-f68c-49b8-a7ae-84418630c63f admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.373488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63342a-f68c-49b8-a7ae-84418630c63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.375553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63342a-f68c-49b8-a7ae-84418630c63f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.447222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 804/1578] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.448200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.480946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 775/1579] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.482337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.482525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.482810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.510874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] MFA Rules not processed for user `88e1b72c30c84c50b4c19f62c5ad0c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:45.512100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:45.518719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589773d-224b-4a08-b3eb-eb0b8ef9fd8c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.575316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.575960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.576242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.576515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.577136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.577469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 776/1580] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:45.579571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.582362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.592861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dbc63-032a-4b46-bae3-5cf95fafac73 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.596417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.597706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.598378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.598662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.598973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.599600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.601557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.704001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 805/1581] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.704844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.731634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 777/1582] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/users => generated 290 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.732574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.743541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbddece-dcd1-40ca-ac55-a536eab2015b admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.769948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e95c3-742b-47d7-b75d-3c89173feef0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.774640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.775333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.775623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.775895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.776547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.778181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.788244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 806/1583] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:45.789186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.798827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1fde6-daec-4160-8693-201defd333d8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.804160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.804922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.805207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.805480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.806069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.806221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.806734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.807017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.807351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] PATH_INFO: `/v3/projects/33c96c7d16c443bc8a2594a7a9a12c76/users/c5f442c825a04800b4550135f4d2cadc/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.807732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.820359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:45.822259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 807/1584] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:45.823118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.824549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c96c7d16c443bc8a2594a7a9a12c76, user_id=c5f442c825a04800b4550135f4d2cadc, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.828807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.833026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a729-ec93-4994-88ac-a5969e9cb6a8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.837604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.838233 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.838514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.838786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.839396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.841364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:45.897091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 778/1585] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:45 2022] PUT /identity/v3/projects/33c96c7d16c443bc8a2594a7a9a12c76/users/c5f442c825a04800b4550135f4d2cadc/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:45.897945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.933973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 808/1586] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:45.933973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:45.942469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff25dcd-ec31-4564-9760-2095804cd37e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.962563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ebd1d-e3ad-44bc-a63a-7d9c4ffd5f61 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:45.967239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:45.967852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:45.968138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:45.968422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:45.969046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:45.971034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.001505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.002157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.002473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.003276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.003941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.005936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.077875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 779/1587] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:46.078899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.089003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411726b7-6241-4cde-8ecb-1f9ac42324bd admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.093744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.094419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.094673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.094949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.095574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.098027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.110155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 809/1588] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:45 2022] POST /identity/v3/projects => generated 363 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:46.115057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.164285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:46.177433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bfb1e-e7b9-465c-8e1a-e0473305df6e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.182161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.182776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.183056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.183330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.183966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.185562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.189231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 780/1589] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:46.190215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.198627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 810/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.198627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.200800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbc3a8-5ea3-41f1-a0f6-f20696e771a3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.205888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbba212-8523-4a1f-b0e1-463cd95b2cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.206523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c850f-deca-4667-837e-a297a11d6eed admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.206929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba212-8523-4a1f-b0e1-463cd95b2cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.207400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba212-8523-4a1f-b0e1-463cd95b2cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.207912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbba212-8523-4a1f-b0e1-463cd95b2cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.209005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbba212-8523-4a1f-b0e1-463cd95b2cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.211537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.211817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbba212-8523-4a1f-b0e1-463cd95b2cc3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.212923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.212923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.212923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.213837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.216099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.226457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 781/1591] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.228103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.228248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 811/1592] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.228533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.228913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.229064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.239580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90427bca-6ee0-4841-877e-ad6d00934bf7 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.244414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.245332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.246212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.246487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.247203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.248791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.249025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:46.250290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.258084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 782/1593] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:46.261664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.261909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 812/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.261909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.272159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547692de-f5e7-4ec3-82e6-e3c032b48ec2 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.276253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15db6ab-2433-4b1a-bb30-35fd1ce1a6c8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.277139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.277883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.278154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.278423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.279093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.280680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.281406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.282176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.282455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.282730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.283427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.286025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.291830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 783/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.292642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.303048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5e31b-1270-493e-86c7-961354b18a1a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.307844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.308462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.308747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.309043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.309682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.311314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.321148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 784/1596] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.322123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.332119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171ab8e-b4b0-4cd0-809f-907ca07989a4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.336764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.337364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.337648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.338020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.338664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.340255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.351896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 785/1597] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.352832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.363328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0243566-8935-430b-8dfd-9cde79a216e2 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.368400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.369060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.374139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.374139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] PATH_INFO: `/v3/projects/00278f66072040eb81f58c782b5f3b51/users/707d6f1cc5ab42bea080eb169350c457/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.385627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=00278f66072040eb81f58c782b5f3b51, user_id=707d6f1cc5ab42bea080eb169350c457, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.388345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.405527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 813/1598] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:46.406469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.416856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e90af-1724-44a9-b4ee-ac47a229f39f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.422056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.422702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.422986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.423258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] PATH_INFO: `/v3/projects/09c5c40394824e13b6d91dfa676a2c3e/users/68eff070a8eb4497af4e8ed2b5110405/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.438235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c5c40394824e13b6d91dfa676a2c3e, user_id=68eff070a8eb4497af4e8ed2b5110405, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.439307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:46.439307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:47:46.439307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:47:46.441237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.496705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 786/1599] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/00278f66072040eb81f58c782b5f3b51/users/707d6f1cc5ab42bea080eb169350c457/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:46.497629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.540138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 814/1600] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/09c5c40394824e13b6d91dfa676a2c3e/users/68eff070a8eb4497af4e8ed2b5110405/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:46.542913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.548992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:46.563436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68646528-bd01-4df0-8e1e-eb5f726accbb admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.600419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7fb1d-7ee8-4cd2-ab64-620a538fbbec admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.604093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.604707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.604992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.605267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.621434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.626354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.626354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.626354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.626354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.626354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.635789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 787/1601] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.636694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.647316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925a506-2f5e-4c81-bfe1-87078b359bfc admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.652913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.653526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.653842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.654120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.654823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.656438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.667473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 788/1602] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.668283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.674504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.676016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.678496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455769a-4f24-4efb-848a-15fad7efb68a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.683211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.683803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.684090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.684364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.684991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.686041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 815/1603] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:46.686617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.686840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.696555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad764a-44a1-4a73-8bd8-edd2fb176510 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.698125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 789/1604] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.702047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.702227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.703056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.703505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.703936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] PATH_INFO: `/v3/projects/7ab181e76ff34eb19f051e6028606da1/users/81a84c3d4bdb46298dd003bde6170d9b/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.713412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c8db-27e8-4c43-8aa3-f176f3cec590 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.717886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f32ed1-4170-42fc-bbdc-335d9ae26331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.718497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f32ed1-4170-42fc-bbdc-335d9ae26331 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.718790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f32ed1-4170-42fc-bbdc-335d9ae26331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.719065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f32ed1-4170-42fc-bbdc-335d9ae26331 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.719709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f32ed1-4170-42fc-bbdc-335d9ae26331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.720665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab181e76ff34eb19f051e6028606da1, user_id=81a84c3d4bdb46298dd003bde6170d9b, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.721982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f32ed1-4170-42fc-bbdc-335d9ae26331 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.723908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.732637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 790/1605] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:46.734407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cedb35-dadc-4110-b669-2794d968e60f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.734696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cedb35-dadc-4110-b669-2794d968e60f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.735018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cedb35-dadc-4110-b669-2794d968e60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.753291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-42cedb35-dadc-4110-b669-2794d968e60f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:46.754568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-42cedb35-dadc-4110-b669-2794d968e60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.762267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 791/1606] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:46.765653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.765653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.765653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.783344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:46.784970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:46.792733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 792/1607] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:46.793521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.803204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1651ec8-1a97-4915-b242-d8660ec4eb3e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.808075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.809214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.809214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.813072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] PATH_INFO: `/v3/projects/e44740712d384718bcd77943fc959757/users/ab73769ad9db4458a0aaa1b685f3b39a/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.831711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 816/1608] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/7ab181e76ff34eb19f051e6028606da1/users/81a84c3d4bdb46298dd003bde6170d9b/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:46.831711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:46.836172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44740712d384718bcd77943fc959757, user_id=ab73769ad9db4458a0aaa1b685f3b39a, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.839431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.842622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:46.897033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95866507-721a-42f8-a327-3566e02c73e7 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:46.901756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:46.902445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:46.902734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:46.903001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] PATH_INFO: `/v3/projects/c73e6993420b4bbe9280d32ebdfc0505/users/790de0d0a3954663b4f2f140517b5ca5/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:46.917117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73e6993420b4bbe9280d32ebdfc0505, user_id=790de0d0a3954663b4f2f140517b5ca5, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:46.919797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:46.954230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 793/1609] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/e44740712d384718bcd77943fc959757/users/ab73769ad9db4458a0aaa1b685f3b39a/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:46.954979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.026014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 817/1610] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/c73e6993420b4bbe9280d32ebdfc0505/users/790de0d0a3954663b4f2f140517b5ca5/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:47.026014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.029367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c31609-553b-48b5-a996-1049cc9d12c4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.060234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:47.093414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a934e8b-f6bb-4611-b7ae-706b0c6a15f3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.095260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.096009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.096301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.096655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] PATH_INFO: `/v3/projects/94cd09760dc94db4a0f44712fe41d3e6/users/a7a6eb1ae2eb4110b6bd689740769aee/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.098173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.098835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.099108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.099377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] PATH_INFO: `/v3/projects/98591e93e41b4d85938385399012922d/users/15fd56ad7f8648448d53729ae5a19fd7/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.112210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94cd09760dc94db4a0f44712fe41d3e6, user_id=a7a6eb1ae2eb4110b6bd689740769aee, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.114273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98591e93e41b4d85938385399012922d, user_id=15fd56ad7f8648448d53729ae5a19fd7, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.117833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.117975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.234776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 818/1611] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:47 2022] PUT /identity/v3/projects/98591e93e41b4d85938385399012922d/users/15fd56ad7f8648448d53729ae5a19fd7/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:47.238277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.246100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 794/1612] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:46 2022] PUT /identity/v3/projects/94cd09760dc94db4a0f44712fe41d3e6/users/a7a6eb1ae2eb4110b6bd689740769aee/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:47.247047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.248878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.310582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e462a-e461-48f8-aaa2-6824a8c8029d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.333102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a883ef2-35e2-4d74-8664-9b6f983154b5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.337002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3a4da-dccc-4ab0-83b4-f96f44d3cf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.337629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a4da-dccc-4ab0-83b4-f96f44d3cf0d service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.337981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a4da-dccc-4ab0-83b4-f96f44d3cf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.338255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3a4da-dccc-4ab0-83b4-f96f44d3cf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.343176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:47.372580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637e5cd-5565-4504-827a-3c459fca0981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.373347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e5cd-5565-4504-827a-3c459fca0981 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.373634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e5cd-5565-4504-827a-3c459fca0981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.374063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e5cd-5565-4504-827a-3c459fca0981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.405468 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3a4da-dccc-4ab0-83b4-f96f44d3cf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.406892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3a4da-dccc-4ab0-83b4-f96f44d3cf0d service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.417207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 795/1613] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:47.418497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791e96-969a-4b7d-b0d7-468dbb106290 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.419723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791e96-969a-4b7d-b0d7-468dbb106290 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.419723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791e96-969a-4b7d-b0d7-468dbb106290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.442344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637e5cd-5565-4504-827a-3c459fca0981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.443967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637e5cd-5565-4504-827a-3c459fca0981 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.451897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a5791e96-969a-4b7d-b0d7-468dbb106290 None None] MFA Rules not processed for user `81a84c3d4bdb46298dd003bde6170d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.453355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a5791e96-969a-4b7d-b0d7-468dbb106290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.456189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 819/1614] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:47.458353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f797-b14b-43df-a216-3beb5a6f0386 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.458952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f797-b14b-43df-a216-3beb5a6f0386 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.459520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7f797-b14b-43df-a216-3beb5a6f0386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.500350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-32b7f797-b14b-43df-a216-3beb5a6f0386 None None] MFA Rules not processed for user `ab73769ad9db4458a0aaa1b685f3b39a`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.503772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-32b7f797-b14b-43df-a216-3beb5a6f0386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.518304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:47.540015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 796/1615] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:47.541154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.541443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.541721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.561991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.563373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.572102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 797/1616] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:47.573000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.583703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a08d81-6055-43da-b001-99b175ca69eb None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.589310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 820/1617] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:47.589538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.590097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.590377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.590652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.591652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.593064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.595224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.595224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.595908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.606519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 798/1618] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:47.607456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.620809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a018b-e36a-4023-80a6-734893ecf685 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.625576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:47.625894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.626482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.626764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.627038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.627721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.628419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:47.629880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.638612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 821/1619] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:47.643621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.655107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5431282-3671-478a-8d83-c22c37b4f706 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.661380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.662204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.662582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.663104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.663702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.665862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.785184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 799/1620] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.786246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.809434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 822/1621] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:47.810554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.872808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:47.881485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292de505-4367-4d64-8409-6064a7a2b9f4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.892505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012c792-2f1c-4d37-9d30-58c85330313b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:47.897755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.899929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.900342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.900616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.951887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:47.952714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:47.953062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:47.953343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] PATH_INFO: `/v3/projects/98591e93e41b4d85938385399012922d/users/15fd56ad7f8648448d53729ae5a19fd7/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:47.955960 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] RBAC: Authorizing `identity:create_grant(project_id=98591e93e41b4d85938385399012922d, user_id=15fd56ad7f8648448d53729ae5a19fd7, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.958985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.973493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 800/1622] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:47 2022] PUT /identity/v3/projects/98591e93e41b4d85938385399012922d/users/15fd56ad7f8648448d53729ae5a19fd7/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:47.974609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:47.979847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:47.981696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:47.994305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 823/1623] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:47.995166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.005619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65857dab-6f1a-47d2-8b7d-325b2498bbbb service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.077439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fa3ab-508d-419e-b246-c0e1f392decb admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.084072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.084856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.085240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.085596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.094699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bcc50-6c7e-41d3-bab9-d645e4bf939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.095430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bcc50-6c7e-41d3-bab9-d645e4bf939c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.095821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bcc50-6c7e-41d3-bab9-d645e4bf939c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.096746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bcc50-6c7e-41d3-bab9-d645e4bf939c admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.097447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bcc50-6c7e-41d3-bab9-d645e4bf939c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.100373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bcc50-6c7e-41d3-bab9-d645e4bf939c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.101794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:48.179699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.181260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.194500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 801/1624] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:48.199810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.215485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 824/1625] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:47 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:48.215631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32e2e7-c47d-48b3-b0f7-7dcfa2dcdb06 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.217740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.218623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.219017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.221695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.222462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.223456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.223743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.224819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.227890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.265073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] MFA Rules not processed for user `15fd56ad7f8648448d53729ae5a19fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:48.269419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:48.355696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 802/1626] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:48 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:48.356762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.372389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8496f7-9e67-4b68-88af-4558fcd9c0e5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.389591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.390633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.391344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.391635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.392668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.394556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.422281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 825/1627] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:48.424714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.429411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 803/1628] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.430621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.438673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:48.450790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecd637-302a-4a5b-8662-fbf98e0efbc4 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.464860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.466006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.468485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.468835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.469927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.474540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.502790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 826/1629] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.504609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.527676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585d57f-c5bf-4fe1-a092-01fec9088d4a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.532768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.533238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.533658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.533988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] PATH_INFO: `/v3/projects/c040af056eda4c1f9424ee6b8982b291/users/66e95eed85e54b1dadd062c3f6e4a32b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.563680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68cf9-100a-4e3a-a4a0-5ca9551ab440 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.564651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c040af056eda4c1f9424ee6b8982b291, user_id=66e95eed85e54b1dadd062c3f6e4a32b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.569472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.573485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.574873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.577408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.577408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.590163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.591695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.604022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 804/1630] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:48.604862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.634845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55011d0-682c-4780-88d0-c9e2eceab194 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.641603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.642079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.642377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.642649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] PATH_INFO: `/v3/projects/79e2177dbe0f4801b02e076bdeac036f/users/c6f9799b6249495cabbdf6394bc545e6/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.667802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e2177dbe0f4801b02e076bdeac036f, user_id=c6f9799b6249495cabbdf6394bc545e6, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.675108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.767671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 827/1631] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/c040af056eda4c1f9424ee6b8982b291/users/66e95eed85e54b1dadd062c3f6e4a32b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:48.776139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.834509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 805/1632] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/79e2177dbe0f4801b02e076bdeac036f/users/c6f9799b6249495cabbdf6394bc545e6/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:48.838671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.887528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5eaf4-bb76-47c2-a997-3db01a577cc2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.928693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a9f87-8265-43be-bbc5-747f5201b48b admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.934929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.935589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.935878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.936150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.936806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.939362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.955403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 806/1633] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.956346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:48.960302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.961705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.962181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.962759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.963567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.966275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.967811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252a2e6-e7a2-40a3-96a2-ec5bc715b51a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:48.973678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:48.974560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:48.974854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:48.975169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] PATH_INFO: `/v3/projects/79e2177dbe0f4801b02e076bdeac036f/users/c6f9799b6249495cabbdf6394bc545e6/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:48.977400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e2177dbe0f4801b02e076bdeac036f, user_id=c6f9799b6249495cabbdf6394bc545e6, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:48.983292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:48.984641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 828/1634] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:48.986354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.000811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbbf06-6663-4a86-b2ef-e2234623a687 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.007780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 807/1635] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/79e2177dbe0f4801b02e076bdeac036f/users/c6f9799b6249495cabbdf6394bc545e6/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:49.009009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.056625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:49.069560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c73e-7f3c-41ff-89dc-c5893b964c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.070352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c73e-7f3c-41ff-89dc-c5893b964c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.070632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c73e-7f3c-41ff-89dc-c5893b964c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.070907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c73e-7f3c-41ff-89dc-c5893b964c9b admin admin] PATH_INFO: `/v3/projects/c040af056eda4c1f9424ee6b8982b291/users/66e95eed85e54b1dadd062c3f6e4a32b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.073340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c73e-7f3c-41ff-89dc-c5893b964c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c040af056eda4c1f9424ee6b8982b291, user_id=66e95eed85e54b1dadd062c3f6e4a32b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.077992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c73e-7f3c-41ff-89dc-c5893b964c9b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.093991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 829/1636] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:48 2022] PUT /identity/v3/projects/c040af056eda4c1f9424ee6b8982b291/users/66e95eed85e54b1dadd062c3f6e4a32b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:49.099766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e79a-a70b-4c2b-bb30-68fa47cadbc3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.100351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e79a-a70b-4c2b-bb30-68fa47cadbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.101351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4e79a-a70b-4c2b-bb30-68fa47cadbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.126750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e944df32-fc8e-4470-9c03-e02a9cd891d8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.147860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9cc4e79a-a70b-4c2b-bb30-68fa47cadbc3 None None] MFA Rules not processed for user `c6f9799b6249495cabbdf6394bc545e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:49.150222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9cc4e79a-a70b-4c2b-bb30-68fa47cadbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.206069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.206069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.206069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.206069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.526153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 830/1637] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:49.526153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.526153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.526153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.537629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.537629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.544951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] MFA Rules not processed for user `66e95eed85e54b1dadd062c3f6e4a32b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:49.544951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.545412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 808/1638] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:49.545412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.545412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca483-3a9e-4650-97ee-7a6ad977baa7 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.545412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaeaf3-cb03-4a11-badf-f14d16ea0501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.547452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaeaf3-cb03-4a11-badf-f14d16ea0501 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.547452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaeaf3-cb03-4a11-badf-f14d16ea0501 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.547452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaeaf3-cb03-4a11-badf-f14d16ea0501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.547452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaeaf3-cb03-4a11-badf-f14d16ea0501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.547452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaeaf3-cb03-4a11-badf-f14d16ea0501 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.547452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 809/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:49.548385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.548385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.548385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.548829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 831/1640] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:49.549172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] MFA Rules not processed for user `707d6f1cc5ab42bea080eb169350c457`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:49.549172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:49.551880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:49.552180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 810/1641] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:49.555131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.644120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8cd96-a4c7-4dbd-9815-dbee3aab471f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.649427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.650219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.650604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.650984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.652152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.654678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.723923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.733580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39d9f-f995-4358-8a07-9ded72796a1b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.737756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.738389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.738669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.738939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.821594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 832/1642] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:47:49 2022] POST /identity/v3/projects => generated 403 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:49.823675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:49.829256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.831586 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:49.843041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 811/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:47:49.953862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917dd486-9ef6-4f8c-af93-5a9b22567cf8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:49.983733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:49.984779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:49.990213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:49.990837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:49.994105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:49.995249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.104299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 833/1644] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:47:49 2022] POST /identity/v3/users => generated 308 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:47:50.108497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.121182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfe1cd-9e75-486a-b25e-fd836cc2cbe4 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.134123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.134894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.135302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.135643 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.136430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.139561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.153275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 812/1645] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:50.157408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.196339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd31f2-0abf-4e32-91f4-0e284ac9b74e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.210335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.211557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.211905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.212300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] PATH_INFO: `/v3/projects/ffa4f60bdaa2474f9318ace8340b781f/users/8ae6ebd0d3c9414488ee595404e7596e/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.254595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa4f60bdaa2474f9318ace8340b781f, user_id=8ae6ebd0d3c9414488ee595404e7596e, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.256684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.408085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.410570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 834/1646] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:50 2022] PUT /identity/v3/projects/ffa4f60bdaa2474f9318ace8340b781f/users/8ae6ebd0d3c9414488ee595404e7596e/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:50.423043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eeff4-6398-47be-ae03-0df9b04dfe11 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.490176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.545525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.545525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.545525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.545525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.545901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.547993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.567884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 813/1647] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:47:50.569422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:50.582871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6af75-abef-4797-ae97-fa0d81d669bb admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.591297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27dcdc-76f6-4b76-b5d8-e74fe443526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.592536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27dcdc-76f6-4b76-b5d8-e74fe443526f admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.592993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27dcdc-76f6-4b76-b5d8-e74fe443526f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.593438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27dcdc-76f6-4b76-b5d8-e74fe443526f admin admin] PATH_INFO: `/v3/projects/ffa4f60bdaa2474f9318ace8340b781f/users/8ae6ebd0d3c9414488ee595404e7596e/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.595853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27dcdc-76f6-4b76-b5d8-e74fe443526f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa4f60bdaa2474f9318ace8340b781f, user_id=8ae6ebd0d3c9414488ee595404e7596e, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.601026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27dcdc-76f6-4b76-b5d8-e74fe443526f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.602559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c5e39-bb26-49b7-8c62-9073d1bc6701 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:50.607094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:50.607857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:50.608209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:50.608558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:50.622147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 814/1648] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:47:50 2022] PUT /identity/v3/projects/ffa4f60bdaa2474f9318ace8340b781f/users/8ae6ebd0d3c9414488ee595404e7596e/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:50.683934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:50.685418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:50.695271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 835/1649] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:50.880548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:51.423496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:53.142210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5db9-0baf-450f-a58c-d8f0f0eee9d4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.142770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5db9-0baf-450f-a58c-d8f0f0eee9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.142980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd5db9-0baf-450f-a58c-d8f0f0eee9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.216073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2acd5db9-0baf-450f-a58c-d8f0f0eee9d4 None None] MFA Rules not processed for user `8ae6ebd0d3c9414488ee595404e7596e`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:53.218750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2acd5db9-0baf-450f-a58c-d8f0f0eee9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:53.268091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:53.387336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 815/1650] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:53.631237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:53.641365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda072e7-b4bb-45a6-9824-bc3c7678bf11 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:53.665679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:53.721005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd8b0a-4aa8-43c3-90b7-58c7ad9cd889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:53.721005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8b0a-4aa8-43c3-90b7-58c7ad9cd889 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:53.721005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8b0a-4aa8-43c3-90b7-58c7ad9cd889 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:53.721005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd8b0a-4aa8-43c3-90b7-58c7ad9cd889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:53.865754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd8b0a-4aa8-43c3-90b7-58c7ad9cd889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:53.870847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd8b0a-4aa8-43c3-90b7-58c7ad9cd889 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:53.903467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 836/1651] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:55.329342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea05e-0f75-4e39-9604-b928b5e4f4f8 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:55.330820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea05e-0f75-4e39-9604-b928b5e4f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:55.331159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea05e-0f75-4e39-9604-b928b5e4f4f8 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:55.336488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 816/1652] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:47:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:47:55.341898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418291f2-d887-442f-a013-82ea80da0873 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:55.342790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418291f2-d887-442f-a013-82ea80da0873 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:55.343223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418291f2-d887-442f-a013-82ea80da0873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:55.366587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-418291f2-d887-442f-a013-82ea80da0873 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:55.371427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-418291f2-d887-442f-a013-82ea80da0873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:55.511286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 837/1653] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:47:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:55.536113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2701-26ec-4f08-b06b-7f158bdd2508 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:55.536396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2701-26ec-4f08-b06b-7f158bdd2508 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:55.536858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2701-26ec-4f08-b06b-7f158bdd2508 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:55.545211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 817/1654] 10.222.0.40 () {54 vars in 961 bytes} [Wed Aug 24 03:47:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:47:55.551471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:55.552025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:55.552790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:55.605374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:47:55.606852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:55.626150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 838/1655] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Aug 24 03:47:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:47:55.638474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af2701-26ec-4f08-b06b-7f158bdd2508 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:55.666186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af2701-26ec-4f08-b06b-7f158bdd2508 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:55.671352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:55.671993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:55.672279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:55.672556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:55.696286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:55.700082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:55.710839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 818/1656] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:47:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:47:58.093870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:58.193171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543d6dc-e6df-4df0-9a66-6e15905b1eca None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:58.200130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:58.200863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:58.201090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:58.201587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] PATH_INFO: `/v3/users/707d6f1cc5ab42bea080eb169350c457` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:58.203292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=707d6f1cc5ab42bea080eb169350c457)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:58.204391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: WARNING py.warnings [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:58.204391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: warnings.warn(msg) Aug 24 03:47:58.204391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: Aug 24 03:47:58.205633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:58.210622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:47:58.533376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707d6f1cc5ab42bea080eb169350c457'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:58.534092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707d6f1cc5ab42bea080eb169350c457'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:58.534746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707d6f1cc5ab42bea080eb169350c457'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:58.556065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707d6f1cc5ab42bea080eb169350c457'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:58.658413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707d6f1cc5ab42bea080eb169350c457'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:58.684498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 839/1657] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:58 2022] DELETE /identity/v3/users/707d6f1cc5ab42bea080eb169350c457 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:59.003404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.026250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146415fd-9b87-4b1a-8c04-0e7c664a7aa7 service placement] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.111288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.112358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.112787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.113635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] PATH_INFO: `/v3/projects/00278f66072040eb81f58c782b5f3b51` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.118776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00278f66072040eb81f58c782b5f3b51)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.119787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: WARNING py.warnings [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 03:47:59.119787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: warnings.warn(msg) Aug 24 03:47:59.119787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: Aug 24 03:47:59.127808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:47:59.307853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00278f66072040eb81f58c782b5f3b51', 'request_id': 'req-109097ab-39f2-46c7-a34b-d2e64a321b2a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:59.365632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00278f66072040eb81f58c782b5f3b51', 'request_id': 'req-109097ab-39f2-46c7-a34b-d2e64a321b2a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:59.396085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00278f66072040eb81f58c782b5f3b51', 'request_id': 'req-109097ab-39f2-46c7-a34b-d2e64a321b2a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:59.566075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] The token cache is being invalidate because project 00278f66072040eb81f58c782b5f3b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:47:59.566381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:59.567690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-109097ab-39f2-46c7-a34b-d2e64a321b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:47:59.571913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 819/1658] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:47:59 2022] DELETE /identity/v3/projects/00278f66072040eb81f58c782b5f3b51 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:47:59.576363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:47:59.577848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:47:59.608173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163395f-3f7d-49ac-8abd-67141949aa8d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:47:59.776165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:47:59.777016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:47:59.778619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:47:59.779020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] PATH_INFO: `/v3/users/8ae6ebd0d3c9414488ee595404e7596e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:47:59.781444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae6ebd0d3c9414488ee595404e7596e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:47:59.785385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.085668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae6ebd0d3c9414488ee595404e7596e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:00.091540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae6ebd0d3c9414488ee595404e7596e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:00.092895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae6ebd0d3c9414488ee595404e7596e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:00.139441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae6ebd0d3c9414488ee595404e7596e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:00.220404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91d6b-cbae-44cb-9398-78d1a5a469fa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.220922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91d6b-cbae-44cb-9398-78d1a5a469fa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.221001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b91d6b-cbae-44cb-9398-78d1a5a469fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.242326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dd101625-b8cf-482d-b57a-e7cc39db6f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae6ebd0d3c9414488ee595404e7596e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:00.259730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:00.267725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 840/1659] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:47:59 2022] DELETE /identity/v3/users/8ae6ebd0d3c9414488ee595404e7596e => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:00.296480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e5b91d6b-cbae-44cb-9398-78d1a5a469fa None None] MFA Rules not processed for user `c5f442c825a04800b4550135f4d2cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:00.300721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e5b91d6b-cbae-44cb-9398-78d1a5a469fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:00.371483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:00.481021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 820/1660] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:00.482067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04c64d-0402-4ec2-bf51-9eea48f2f057 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.483076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04c64d-0402-4ec2-bf51-9eea48f2f057 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.483488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04c64d-0402-4ec2-bf51-9eea48f2f057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.520818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-cb04c64d-0402-4ec2-bf51-9eea48f2f057 None None] MFA Rules not processed for user `c5f442c825a04800b4550135f4d2cadc`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:00.522439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cb04c64d-0402-4ec2-bf51-9eea48f2f057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:00.546643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 841/1661] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:00.595188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f780-7ba0-47d4-b201-d4dc6a5e09e2 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.595731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f780-7ba0-47d4-b201-d4dc6a5e09e2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.596145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47f780-7ba0-47d4-b201-d4dc6a5e09e2 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.598782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 821/1662] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 24 03:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:00.620782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.621614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.624643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.703947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:00.705331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:00.850436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 842/1663] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 24 03:48:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:00.861655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f780-7ba0-47d4-b201-d4dc6a5e09e2 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:00.887809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47f780-7ba0-47d4-b201-d4dc6a5e09e2 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:00.898988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:00.905978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:00.905978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:00.905978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:00.919642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:00.921483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:00.944270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 822/1664] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:01.338472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.342115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:01.427279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:01.428174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:01.490905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe5ea4-53a2-44f9-a803-c80775625bc2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.499202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.500030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.500560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.500954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] PATH_INFO: `/v3/users/81a84c3d4bdb46298dd003bde6170d9b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.502324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a84c3d4bdb46298dd003bde6170d9b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.508242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.571329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf85ba6-5211-4c6c-b160-7eb78ddbb4af service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:01.576716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:01.577899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.588930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.588930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] PATH_INFO: `/v3/projects/ffa4f60bdaa2474f9318ace8340b781f` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.588930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa4f60bdaa2474f9318ace8340b781f)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:01.588930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:01.832026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a84c3d4bdb46298dd003bde6170d9b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.834862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a84c3d4bdb46298dd003bde6170d9b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.837320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a84c3d4bdb46298dd003bde6170d9b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.842280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa4f60bdaa2474f9318ace8340b781f', 'request_id': 'req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.860368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa4f60bdaa2474f9318ace8340b781f', 'request_id': 'req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.878430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa4f60bdaa2474f9318ace8340b781f', 'request_id': 'req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.891039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a84c3d4bdb46298dd003bde6170d9b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.949699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] The token cache is being invalidate because project ffa4f60bdaa2474f9318ace8340b781f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:01.955009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.955009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b5f9f7fe-5b1b-4848-8aa7-e99fa1004f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:01.955694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 823/1665] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:01 2022] DELETE /identity/v3/projects/ffa4f60bdaa2474f9318ace8340b781f => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:01.957306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87c7c7-57e2-4561-9708-2cafd5f96898 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.957549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87c7c7-57e2-4561-9708-2cafd5f96898 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.957981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87c7c7-57e2-4561-9708-2cafd5f96898 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:01.967872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 824/1666] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 24 03:48:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:01.972681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991d2ee-1d87-4a40-9e51-7d9c7be6bd62 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:01.979458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991d2ee-1d87-4a40-9e51-7d9c7be6bd62 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:01.979458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991d2ee-1d87-4a40-9e51-7d9c7be6bd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.019614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1118cfcc-7816-406f-8ed3-bf4a3a50d55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a84c3d4bdb46298dd003bde6170d9b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:02.040500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c991d2ee-1d87-4a40-9e51-7d9c7be6bd62 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.041926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c991d2ee-1d87-4a40-9e51-7d9c7be6bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.061009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 843/1667] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:01 2022] DELETE /identity/v3/users/81a84c3d4bdb46298dd003bde6170d9b => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:02.061009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.061009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.061009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.085847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.087291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.277532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 825/1668] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.278390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ac5a-ade9-4349-bb8a-cdb54fbd2ce9 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.279163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ac5a-ade9-4349-bb8a-cdb54fbd2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.281422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0ac5a-ade9-4349-bb8a-cdb54fbd2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.311369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 844/1669] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.312085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.319388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.349877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-38d0ac5a-ade9-4349-bb8a-cdb54fbd2ce9 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.351475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-38d0ac5a-ade9-4349-bb8a-cdb54fbd2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.371294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550d381-f7ed-442a-b279-adfdb3858a99 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.391215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 826/1670] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.392524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.392880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.393165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.397730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.398759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.399368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.400709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] PATH_INFO: `/v3/users/88e1b72c30c84c50b4c19f62c5ad0c0b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.404335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e1b72c30c84c50b4c19f62c5ad0c0b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.408407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.462386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:02.464349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.481430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 827/1671] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:02.484365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.484728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.684936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e1b72c30c84c50b4c19f62c5ad0c0b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:02.687077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e1b72c30c84c50b4c19f62c5ad0c0b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:02.690603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e1b72c30c84c50b4c19f62c5ad0c0b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:02.693452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67da590-0ec5-4f7a-9269-fd292c966059 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:02.705444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:02.706883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:02.707176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:02.709205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:02.727405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.757019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e1b72c30c84c50b4c19f62c5ad0c0b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:02.800274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:02.802956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:02.823770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 828/1672] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:02.825534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.830766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.864978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e1b72c30c84c50b4c19f62c5ad0c0b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:02.893560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 845/1673] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:02 2022] DELETE /identity/v3/users/88e1b72c30c84c50b4c19f62c5ad0c0b => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:02.899668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:02.899668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:02.968367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.006263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd572c-9217-4f9a-8260-e1bb4e6e44cc service glance] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.115600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47721ee0-55f3-4c7f-9c16-a9458ab05899 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.138566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.139240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.139533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.139980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.140460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:03.141054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.142348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.142777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a55926-5c7b-4879-a481-af5dd6c78053 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.143177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.143464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.143772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.146194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.169007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 846/1674] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:03.170389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c615-7239-4f7e-b493-64200294c93d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.170705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c615-7239-4f7e-b493-64200294c93d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.170983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c615-7239-4f7e-b493-64200294c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.185987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.190362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.210569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 829/1675] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:03.211477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.213401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7512c615-7239-4f7e-b493-64200294c93d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:03.214728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7512c615-7239-4f7e-b493-64200294c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.224214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9608d-8bc0-4f34-a936-ccd623adcd39 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.224448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 847/1676] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:03.232318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.233042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.233411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.233753 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.234809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.237029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.255444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:03.272940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512c615-7239-4f7e-b493-64200294c93d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.274458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7512c615-7239-4f7e-b493-64200294c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.293162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512c615-7239-4f7e-b493-64200294c93d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.298017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad5979-4f8b-4d67-85ca-fafedf3cc3fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.317415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad5979-4f8b-4d67-85ca-fafedf3cc3fb service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.317415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad5979-4f8b-4d67-85ca-fafedf3cc3fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.317415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad5979-4f8b-4d67-85ca-fafedf3cc3fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.317415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad5979-4f8b-4d67-85ca-fafedf3cc3fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.317415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad5979-4f8b-4d67-85ca-fafedf3cc3fb service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.329386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 848/1677] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:03.408529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc1de2-7b14-49b0-89f0-94aa19bafb18 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.408922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc1de2-7b14-49b0-89f0-94aa19bafb18 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.409325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc1de2-7b14-49b0-89f0-94aa19bafb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.412069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 830/1678] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:03.422137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:03.523253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ccdc1de2-7b14-49b0-89f0-94aa19bafb18 None None] MFA Rules not processed for user `68eff070a8eb4497af4e8ed2b5110405`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:03.523518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ccdc1de2-7b14-49b0-89f0-94aa19bafb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.719655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 849/1679] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:03.730267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f603-8ee8-4449-b3ae-f600ad6709ec None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.730851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f603-8ee8-4449-b3ae-f600ad6709ec None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.733418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043f603-8ee8-4449-b3ae-f600ad6709ec None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.736426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 850/1680] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 24 03:48:03 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:03.742961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b071c50-f6a4-4548-8b94-a787677165ee None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.743503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b071c50-f6a4-4548-8b94-a787677165ee None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.744277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b071c50-f6a4-4548-8b94-a787677165ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.755800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5ed4-c9bb-4ec2-9c61-d8df6abefb1e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:03.785886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bc9a1-3ca3-497c-a28b-eec20ede7d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:03.790837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bc9a1-3ca3-497c-a28b-eec20ede7d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.791224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bc9a1-3ca3-497c-a28b-eec20ede7d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.792157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bc9a1-3ca3-497c-a28b-eec20ede7d93 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.796868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bc9a1-3ca3-497c-a28b-eec20ede7d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:03.804263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bc9a1-3ca3-497c-a28b-eec20ede7d93 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:03.844646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0b071c50-f6a4-4548-8b94-a787677165ee None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:03.845804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0b071c50-f6a4-4548-8b94-a787677165ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:03.940165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 831/1681] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/users => generated 287 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:03.941911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e42d-fba4-4cd5-8059-4a1c34fc211d None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:03.943087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e42d-fba4-4cd5-8059-4a1c34fc211d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:03.943525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743e42d-fba4-4cd5-8059-4a1c34fc211d None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:03.958627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 832/1682] 10.222.0.40 () {54 vars in 962 bytes} [Wed Aug 24 03:48:03 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:03.959830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e42d-fba4-4cd5-8059-4a1c34fc211d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.015064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743e42d-fba4-4cd5-8059-4a1c34fc211d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.022553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.023336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.023633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.023913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.024837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.026303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 851/1683] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:04.026765 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.028729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.031323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.031628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.046147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 833/1684] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:04.051700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.067602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:04.069177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.074870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4507-4852-4df7-8371-9efa9912d6b8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.089162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.089924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.090216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.090496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.092607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.094817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.122216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 834/1685] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:04.126690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.142506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5189d9d-423a-4c9a-81a0-1f9e83403506 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.156573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce9eb8-003d-4805-b68c-02d9d4785273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.157273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9eb8-003d-4805-b68c-02d9d4785273 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.157571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9eb8-003d-4805-b68c-02d9d4785273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.159247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce9eb8-003d-4805-b68c-02d9d4785273 admin admin] PATH_INFO: `/v3/projects/cb0597fc7a444a9c93c3bec3e0d7981b/users/6efadb5ff4e34732b898a6d74c54714f/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.195833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce9eb8-003d-4805-b68c-02d9d4785273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb0597fc7a444a9c93c3bec3e0d7981b, user_id=6efadb5ff4e34732b898a6d74c54714f, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.202645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce9eb8-003d-4805-b68c-02d9d4785273 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.275407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 852/1686] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Aug 24 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:04.286990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.307040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6e6da-2808-47e2-93ce-f3ba50da5359 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.334407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.335150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.335437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.335717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.347772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 835/1687] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:04 2022] PUT /identity/v3/projects/cb0597fc7a444a9c93c3bec3e0d7981b/users/6efadb5ff4e34732b898a6d74c54714f/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:04.358719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.359167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.359455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.370071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.371715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.430102 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 853/1688] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:04.449658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.481425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] MFA Rules not processed for user `6efadb5ff4e34732b898a6d74c54714f`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:04.483128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:04.487201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc20e8-e981-4d0f-a89d-2f1d1f421cc8 service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.688621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.693506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 836/1689] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:04.693631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.694051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.694337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.698819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:04.728859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.730352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:04.762851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 854/1690] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:04.887170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e61fe4-9235-4d1e-8782-a214a8bd0777 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:04.903805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:04.905531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:04.906419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:04.906717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:04.907551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:04.913779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.036748 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 837/1691] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:04 2022] POST /identity/v3/projects => generated 373 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:05.037023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.054960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c6441-532d-46a6-8d59-42d23df4d465 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.060897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.064498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:05.293032 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.293656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.294200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.295117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.295893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.302247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.308763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db487979-47e6-48a6-9bf4-47138bb8208e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.325710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.326654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.327049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.327607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] PATH_INFO: `/v3/projects/78268c610838407c964c5b0e1ff2a828` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.332452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78268c610838407c964c5b0e1ff2a828)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.341823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.437951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 855/1692] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:05 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:05.442969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.461689 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab086904-f108-4ffd-889b-dea2a2285d75 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.474772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.474772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.474772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.474772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.475191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.475191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.514043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78268c610838407c964c5b0e1ff2a828', 'request_id': 'req-d00545b2-ced5-4f69-b3a7-919adae721f1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.518329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 856/1693] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:05.522147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.530889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78268c610838407c964c5b0e1ff2a828', 'request_id': 'req-d00545b2-ced5-4f69-b3a7-919adae721f1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.549632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40f96c-2af6-426f-b74c-2bfdd489d1d6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.552772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78268c610838407c964c5b0e1ff2a828', 'request_id': 'req-d00545b2-ced5-4f69-b3a7-919adae721f1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.669668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.670360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.670694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.670977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] PATH_INFO: `/v3/projects/7156f11395a84d78b95421302128a1f2/users/8ddfd32a8aa64c6a90cbc149c8818692/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.704076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7156f11395a84d78b95421302128a1f2, user_id=8ddfd32a8aa64c6a90cbc149c8818692, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.722827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] The token cache is being invalidate because project 78268c610838407c964c5b0e1ff2a828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:05.722827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.723946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:05.726719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 838/1694] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:05 2022] DELETE /identity/v3/projects/78268c610838407c964c5b0e1ff2a828 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:05.730337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.730963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.738577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:05.775882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00545b2-ced5-4f69-b3a7-919adae721f1 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:05.787553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:05.788370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:05.788729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:05.790084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] PATH_INFO: `/v3/users/15fd56ad7f8648448d53729ae5a19fd7` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:05.797576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fd56ad7f8648448d53729ae5a19fd7)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:05.797576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:05.862616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 857/1695] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:05 2022] PUT /identity/v3/projects/7156f11395a84d78b95421302128a1f2/users/8ddfd32a8aa64c6a90cbc149c8818692/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:05.868355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:05.871700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.030844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:06.159421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fd56ad7f8648448d53729ae5a19fd7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.160916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fd56ad7f8648448d53729ae5a19fd7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.166284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fd56ad7f8648448d53729ae5a19fd7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.201902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fd56ad7f8648448d53729ae5a19fd7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.210798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67662541-1aa6-4519-ac7d-223bf3bfa1f2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:06.219056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39824-f7da-4ba3-a640-897b4279ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:06.221181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39824-f7da-4ba3-a640-897b4279ebeb admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.221467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39824-f7da-4ba3-a640-897b4279ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.222612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39824-f7da-4ba3-a640-897b4279ebeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.223415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca39824-f7da-4ba3-a640-897b4279ebeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:06.227735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca39824-f7da-4ba3-a640-897b4279ebeb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:06.242189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 858/1696] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:06.246377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0505ac9-fc70-4fdd-a737-3ee6c66da3c2 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.246950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0505ac9-fc70-4fdd-a737-3ee6c66da3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.247474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0505ac9-fc70-4fdd-a737-3ee6c66da3c2 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.249508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 859/1697] 10.222.0.40 () {54 vars in 912 bytes} [Wed Aug 24 03:48:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:06.251755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0505ac9-fc70-4fdd-a737-3ee6c66da3c2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:06.257670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f0505ac9-fc70-4fdd-a737-3ee6c66da3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.328091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fd56ad7f8648448d53729ae5a19fd7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:06.357061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 839/1698] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:05 2022] DELETE /identity/v3/users/15fd56ad7f8648448d53729ae5a19fd7 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:06.358493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:06.373495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.392514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:06.445580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0505ac9-fc70-4fdd-a737-3ee6c66da3c2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:06.532394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f4574-5adc-448b-ab6c-ea140b7a8d01 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:06.545527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d9487-9dbf-4f55-9adb-2190c870391f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:06.546533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9487-9dbf-4f55-9adb-2190c870391f admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.547013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9487-9dbf-4f55-9adb-2190c870391f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.547468 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d9487-9dbf-4f55-9adb-2190c870391f admin admin] PATH_INFO: `/v3/projects/7156f11395a84d78b95421302128a1f2/users/8ddfd32a8aa64c6a90cbc149c8818692/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.549669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9487-9dbf-4f55-9adb-2190c870391f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7156f11395a84d78b95421302128a1f2, user_id=8ddfd32a8aa64c6a90cbc149c8818692, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:06.554893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d9487-9dbf-4f55-9adb-2190c870391f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:06.622280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 840/1699] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:06 2022] PUT /identity/v3/projects/7156f11395a84d78b95421302128a1f2/users/8ddfd32a8aa64c6a90cbc149c8818692/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:06.628141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56238d6-ae38-46b4-8831-3be3ffa72229 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.629029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56238d6-ae38-46b4-8831-3be3ffa72229 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.630109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56238d6-ae38-46b4-8831-3be3ffa72229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.651066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:06.651066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.651066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.651066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.656135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.693982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:06.697596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e56238d6-ae38-46b4-8831-3be3ffa72229 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:06.700884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:06.713453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e56238d6-ae38-46b4-8831-3be3ffa72229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.736964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 860/1700] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:06.737672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:06.751028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:06.788422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dda450-2435-4940-9ff1-1b6d13a65674 service placement] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:06.977389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:06.978108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:06.980336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:06.980642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] PATH_INFO: `/v3/projects/7ab181e76ff34eb19f051e6028606da1` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:06.988954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab181e76ff34eb19f051e6028606da1)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:06.992477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:07.000202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 841/1701] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:07.000435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e10faa-2863-4704-bc61-916173265cdc None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:07.000727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e10faa-2863-4704-bc61-916173265cdc None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:07.001002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e10faa-2863-4704-bc61-916173265cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:07.043085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:07.118389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f7e10faa-2863-4704-bc61-916173265cdc None None] MFA Rules not processed for user `790de0d0a3954663b4f2f140517b5ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:07.123590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f7e10faa-2863-4704-bc61-916173265cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.220015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab181e76ff34eb19f051e6028606da1', 'request_id': 'req-07456671-933f-4f54-a86f-7d86f3023cb9'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.244181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab181e76ff34eb19f051e6028606da1', 'request_id': 'req-07456671-933f-4f54-a86f-7d86f3023cb9'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.314967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 842/1702] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:07.316481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:07.317615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:07.317924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:07.381959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] MFA Rules not processed for user `8ddfd32a8aa64c6a90cbc149c8818692`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:07.386622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.449328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab181e76ff34eb19f051e6028606da1', 'request_id': 'req-07456671-933f-4f54-a86f-7d86f3023cb9'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.476620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] The token cache is being invalidate because project 7ab181e76ff34eb19f051e6028606da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:07.477185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.482629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:07.488610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 861/1703] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:06 2022] DELETE /identity/v3/projects/7ab181e76ff34eb19f051e6028606da1 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:07.488835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:07.492805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.589484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 843/1704] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:07.590789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:07.592398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.647974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07456671-933f-4f54-a86f-7d86f3023cb9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:07.654911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:07.656063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:07.656506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:07.657114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:07.660708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.710005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c9d63-ac28-492a-a1c3-45cc74ad63b6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:07.720936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:07.721687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:07.723434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:07.723819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:07.726631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:07.914548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:07.924980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:07.980387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 862/1705] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:07.983171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:07.991075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:08.009240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.011137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.028118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 844/1706] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:08.036445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:08.036445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:08.172084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8ffad-daab-41d5-9f71-bdfa3fb2f8d5 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.189352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.190883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.191179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.191457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] PATH_INFO: `/v3/users/66e95eed85e54b1dadd062c3f6e4a32b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.194506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e95eed85e54b1dadd062c3f6e4a32b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.198422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.249347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3d2cb8-a444-4f69-98e2-eb742d1cf773 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.261397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.263418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.271543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.272784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.302681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.309961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.350434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 845/1707] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:08.351389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:08.353223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:08.410183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e0844-03a6-42c0-9e21-d7301f7acf5c service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:08.424474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:08.425299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.427576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.428004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] PATH_INFO: `/v3/projects/98591e93e41b4d85938385399012922d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.430926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98591e93e41b4d85938385399012922d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:08.448339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:08.486986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e95eed85e54b1dadd062c3f6e4a32b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.493242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e95eed85e54b1dadd062c3f6e4a32b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.496164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e95eed85e54b1dadd062c3f6e4a32b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.541530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e95eed85e54b1dadd062c3f6e4a32b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.654852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b06fa61b-9639-4888-9d35-d4c649f56491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e95eed85e54b1dadd062c3f6e4a32b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.686849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 863/1708] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:07 2022] DELETE /identity/v3/users/66e95eed85e54b1dadd062c3f6e4a32b => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:08.773655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98591e93e41b4d85938385399012922d', 'request_id': 'req-f9a32ed2-9351-40d9-b863-87557b524379'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.806371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98591e93e41b4d85938385399012922d', 'request_id': 'req-f9a32ed2-9351-40d9-b863-87557b524379'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.840058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98591e93e41b4d85938385399012922d', 'request_id': 'req-f9a32ed2-9351-40d9-b863-87557b524379'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.877756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:08.935634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:08.944355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] The token cache is being invalidate because project 98591e93e41b4d85938385399012922d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:08.944912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.946280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f9a32ed2-9351-40d9-b863-87557b524379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:08.949093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 846/1709] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:08 2022] DELETE /identity/v3/projects/98591e93e41b4d85938385399012922d => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:08.954950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:08.955240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:08.955527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:08.990461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:09.002005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.169492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 864/1710] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:09.176156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.176455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.176740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.241874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:09.245945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.273616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 847/1711] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:09.282771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.293409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd842f-8c4f-4dab-923e-b9191a3d5041 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.311516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.312179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.312462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.313985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.314826 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:09.315143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.324701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ef6a9-c6f4-4d64-a2b2-67bf5546716e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.363368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 865/1712] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:09.364657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.381098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cea52-2d0b-404a-9937-5ebb25a79aed None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.397916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.398856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.399309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.399588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.400243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.403579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:09.550013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.556329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.556329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.564058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 848/1713] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:09.568990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.683588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] MFA Rules not processed for user `a7a6eb1ae2eb4110b6bd689740769aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:09.694041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.728947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:09.918760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f061b02-41bf-4da5-90a1-9e45791256df admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:09.927016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 866/1714] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:09.941169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:09.943744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:09.972833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:09.977628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:09.979203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:09.980018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:09.980845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:09.983189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.139565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 849/1715] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:09 2022] POST /identity/v3/users => generated 293 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:10.144212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.155288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b73148-c8ee-4b8f-9bcb-acbf8a2fedd5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.162374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e4c4ce-f103-4ca5-8700-e941e2f414c7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.168748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.169568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.173186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.173666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.212446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.216588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.247523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.247805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 867/1716] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:10.248166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.248452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.248730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.249978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.256369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.259896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.262643 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.304221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 850/1717] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:10.305230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.325192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f768d9-bc2c-4316-b8dd-6ecb85c148ff service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.327128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368aaa71-fb43-449b-872b-e0d229194ee3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.337396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.338149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.338556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.338836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] PATH_INFO: `/v3/users/6efadb5ff4e34732b898a6d74c54714f` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.340694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.341849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.342141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.342412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.343126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.344697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efadb5ff4e34732b898a6d74c54714f)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.346875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.351448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.376105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 851/1718] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:10.391055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.427266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea9806-4af2-44a4-86ce-eff199d9f3f1 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.445172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.447099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.447402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.448102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] PATH_INFO: `/v3/projects/a6a067ba532f45a38fa761039ac22cd6/users/a7b9f8733cce4567b7cfae6f32a7e19c/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.495916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6a067ba532f45a38fa761039ac22cd6, user_id=a7b9f8733cce4567b7cfae6f32a7e19c, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.503858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.669674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efadb5ff4e34732b898a6d74c54714f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.670553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efadb5ff4e34732b898a6d74c54714f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.671315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efadb5ff4e34732b898a6d74c54714f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.694993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 852/1719] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:10 2022] PUT /identity/v3/projects/a6a067ba532f45a38fa761039ac22cd6/users/a7b9f8733cce4567b7cfae6f32a7e19c/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:10.695906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:10.703321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:10.721496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efadb5ff4e34732b898a6d74c54714f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.816187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba682418-29c4-4247-a543-81d7f5e002cf admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:10.826861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:10.827427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.827766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.829119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] PATH_INFO: `/v3/projects/c040af056eda4c1f9424ee6b8982b291` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.829360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c040af056eda4c1f9424ee6b8982b291)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:10.831496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:10.837314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6e35366e-d842-4b25-b578-648a8c2df1e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efadb5ff4e34732b898a6d74c54714f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:10.863781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 868/1720] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:10 2022] DELETE /identity/v3/users/6efadb5ff4e34732b898a6d74c54714f => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:10.868388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa558d-abf5-49a5-871b-dc25ada0e3b5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:10.871428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa558d-abf5-49a5-871b-dc25ada0e3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:10.871428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa558d-abf5-49a5-871b-dc25ada0e3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:10.922115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-74fa558d-abf5-49a5-871b-dc25ada0e3b5 None None] MFA Rules not processed for user `a7b9f8733cce4567b7cfae6f32a7e19c`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:10.923261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-74fa558d-abf5-49a5-871b-dc25ada0e3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.062417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c040af056eda4c1f9424ee6b8982b291', 'request_id': 'req-8d509631-24ed-4835-a56e-c48018649e7a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.090739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 869/1721] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:11.092701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73638b-9a42-4da4-a1a8-c73a558dafee None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.093009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73638b-9a42-4da4-a1a8-c73a558dafee None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.093413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73638b-9a42-4da4-a1a8-c73a558dafee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.102302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c040af056eda4c1f9424ee6b8982b291', 'request_id': 'req-8d509631-24ed-4835-a56e-c48018649e7a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.120605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ad73638b-9a42-4da4-a1a8-c73a558dafee None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:11.121101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ad73638b-9a42-4da4-a1a8-c73a558dafee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.124137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c040af056eda4c1f9424ee6b8982b291', 'request_id': 'req-8d509631-24ed-4835-a56e-c48018649e7a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.255228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] The token cache is being invalidate because project c040af056eda4c1f9424ee6b8982b291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:11.255649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.257431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:11.264354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 853/1722] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:10 2022] DELETE /identity/v3/projects/c040af056eda4c1f9424ee6b8982b291 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:11.264354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.265203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.282236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 870/1723] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:11.285669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.285999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.289944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.320102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d509631-24ed-4835-a56e-c48018649e7a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.341322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:11.347347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0ec5f-36d9-4574-ad0e-86e3da3a2df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.347491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.347575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0ec5f-36d9-4574-ad0e-86e3da3a2df0 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.347575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0ec5f-36d9-4574-ad0e-86e3da3a2df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.347575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0ec5f-36d9-4574-ad0e-86e3da3a2df0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.354949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0ec5f-36d9-4574-ad0e-86e3da3a2df0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.358371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b0ec5f-36d9-4574-ad0e-86e3da3a2df0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.371062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:11.383026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 871/1724] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:11.387624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.390966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.481111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:11.489869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 854/1725] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:11.491859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.492413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.493089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.528130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:11.529991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.539149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0050b8-2726-49d6-854a-b4888d6eccb7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.606339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.607045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.607675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.608413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.610419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:11.680103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 855/1726] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:11.690911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.711543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.714272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.715911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a5bc4-ab45-443a-b06e-5c8ce743854a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.741885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 872/1727] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:11.745744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.745744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.745744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.745744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.746094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.746167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.748343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.774282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d33acd-45c0-4771-ac22-3326199cf260 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.781973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.782798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.783086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.783413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.784417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:11.784712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.788143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.810903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 873/1728] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:11.812623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.822949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 856/1729] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:11.830003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.832113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae7688-d223-4d92-a016-2b925c769d23 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.839717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c628a-0c34-4c33-a4bd-3a1a2fecbbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.840362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c628a-0c34-4c33-a4bd-3a1a2fecbbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.840647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c628a-0c34-4c33-a4bd-3a1a2fecbbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.840922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c628a-0c34-4c33-a4bd-3a1a2fecbbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.841557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c628a-0c34-4c33-a4bd-3a1a2fecbbc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.841916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae5898-fa28-4e0a-b8de-11cbd5510fb8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.844248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c628a-0c34-4c33-a4bd-3a1a2fecbbc8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.848141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.848847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.849249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.850338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.851086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.852848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.871157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 857/1730] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:11.872179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:11.905255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871fd32-9b32-45f8-8866-dc2ca06bc2a9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:11.911107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:11.912486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.912925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.913336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] PATH_INFO: `/v3/projects/d92cf8cc023544ed99d2c591f1505426/users/a0030d28a49c4279ae87e599e762ab75/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:11.934675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92cf8cc023544ed99d2c591f1505426, user_id=a0030d28a49c4279ae87e599e762ab75, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:11.937989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:11.981472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 874/1731] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:11.983021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:11.983435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:11.983854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.036144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] MFA Rules not processed for user `68eff070a8eb4497af4e8ed2b5110405`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:12.043648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:12.097719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 858/1732] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:11 2022] PUT /identity/v3/projects/d92cf8cc023544ed99d2c591f1505426/users/a0030d28a49c4279ae87e599e762ab75/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:12.098995 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.215565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 875/1733] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:12.216544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.290274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3135-53b0-4382-9dea-dc8907e51359 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.296216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.297024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.297312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.297585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.298276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.301201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.388623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 859/1734] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:12 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:12.394117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.424502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646dd0f-4958-4480-bc87-e9f780292d51 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.441625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.443919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.444598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.445092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.446680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.462373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.464415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74b43d-47a1-40ea-a1e9-ae1ddf32f208 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.479948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.480549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.480829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.481088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.481830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.483503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.515367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 860/1735] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:12.518123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 876/1736] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:12.521289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.526869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.563077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cfbe43-868c-4317-b74b-89044a99e94c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.571113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397fa5e-6070-41b3-a9ad-ddc3f7aad611 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.572386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.575212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.577660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bd270-5f86-44cf-bae1-da51682a922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.578837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bd270-5f86-44cf-bae1-da51682a922e admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.579274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bd270-5f86-44cf-bae1-da51682a922e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.579697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bd270-5f86-44cf-bae1-da51682a922e admin admin] PATH_INFO: `/v3/projects/d92cf8cc023544ed99d2c591f1505426/users/a0030d28a49c4279ae87e599e762ab75/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.579996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.581296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.582865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.585673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bd270-5f86-44cf-bae1-da51682a922e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92cf8cc023544ed99d2c591f1505426, user_id=a0030d28a49c4279ae87e599e762ab75, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.589222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.593341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bd270-5f86-44cf-bae1-da51682a922e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.630152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 861/1737] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:12.635268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.643784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 877/1738] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:12 2022] PUT /identity/v3/projects/d92cf8cc023544ed99d2c591f1505426/users/a0030d28a49c4279ae87e599e762ab75/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:12.657180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.657449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.657922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.686943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83722e-cbac-4cf2-8c17-134a7753d2ae admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:12.720404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] MFA Rules not processed for user `a0030d28a49c4279ae87e599e762ab75`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:12.721636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:12.799113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c001e6-2e29-4084-a9a5-8b2f5989309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:12.799991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c001e6-2e29-4084-a9a5-8b2f5989309f admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.801268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c001e6-2e29-4084-a9a5-8b2f5989309f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.801654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c001e6-2e29-4084-a9a5-8b2f5989309f admin admin] PATH_INFO: `/v3/projects/df624d67dc314aa68734ed7d5e8391be/users/045833926c2c42aeaae188844232431e/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:12.837319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c001e6-2e29-4084-a9a5-8b2f5989309f admin admin] RBAC: Authorizing `identity:create_grant(project_id=df624d67dc314aa68734ed7d5e8391be, user_id=045833926c2c42aeaae188844232431e, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:12.858832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c001e6-2e29-4084-a9a5-8b2f5989309f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:12.885825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 878/1739] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:12.898765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:12.900759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:12.973110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 862/1740] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:12 2022] PUT /identity/v3/projects/df624d67dc314aa68734ed7d5e8391be/users/045833926c2c42aeaae188844232431e/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:12.984376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:12.984849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:12.985261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.046866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] MFA Rules not processed for user `045833926c2c42aeaae188844232431e`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:13.048775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.054969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59bea0-f314-45b2-ab98-1c8b9e8a7da5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.176447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:13.184104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184cb7a-9906-4f21-a248-d275aff44427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.185091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cb7a-9906-4f21-a248-d275aff44427 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.185467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cb7a-9906-4f21-a248-d275aff44427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.185912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184cb7a-9906-4f21-a248-d275aff44427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.236148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 863/1741] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:13.244373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.309016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184cb7a-9906-4f21-a248-d275aff44427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.311661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184cb7a-9906-4f21-a248-d275aff44427 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.336867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 879/1742] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:13.337701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaaf12-5a6f-4d38-9ec3-251890b95b1e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.352727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.352727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.352727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.352727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.353008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.353008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.353128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.353128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.353128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.438900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:13.440129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:13.486450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 864/1743] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:13.486450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.654155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e194c-e424-4fed-b7c5-7df038202438 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.655024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.655451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.655690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.655958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] PATH_INFO: `/v3/users/a7b9f8733cce4567b7cfae6f32a7e19c` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.659408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b9f8733cce4567b7cfae6f32a7e19c)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.659894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.666008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 880/1744] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:13.666903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.696199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f3e9c-1a67-4549-846a-3e0fb72e3434 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.701672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.702545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.702900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.703181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.703813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.705794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:13.912828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 881/1745] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:13 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:13.918481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:13.970359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5c3a3-b317-4cfc-960e-c09b0293fdf8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:13.984278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:13.985298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:13.985891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:13.986381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:13.987252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:13.991244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.014020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 882/1746] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:14.018291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.021536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.050292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc325a-be7a-4776-b111-e46ce59196f4 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.055922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.056560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b9f8733cce4567b7cfae6f32a7e19c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.057108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.057256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b9f8733cce4567b7cfae6f32a7e19c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.057731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.058110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b9f8733cce4567b7cfae6f32a7e19c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.058428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] PATH_INFO: `/v3/projects/cb0597fc7a444a9c93c3bec3e0d7981b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.059848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb0597fc7a444a9c93c3bec3e0d7981b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.062038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.088470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b9f8733cce4567b7cfae6f32a7e19c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.254123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b9f8733cce4567b7cfae6f32a7e19c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.272595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 865/1747] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:13 2022] DELETE /identity/v3/users/a7b9f8733cce4567b7cfae6f32a7e19c => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.272595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.274030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.356158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb0597fc7a444a9c93c3bec3e0d7981b', 'request_id': 'req-3179a843-720b-4e03-ab30-744d7298e8bb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.379037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb0597fc7a444a9c93c3bec3e0d7981b', 'request_id': 'req-3179a843-720b-4e03-ab30-744d7298e8bb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.395646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d859b3-bed7-492b-8007-b3a54c16e899 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.476582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb0597fc7a444a9c93c3bec3e0d7981b', 'request_id': 'req-3179a843-720b-4e03-ab30-744d7298e8bb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.480847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676bf14-a64b-4881-961c-ff0968a88d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.480847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bf14-a64b-4881-961c-ff0968a88d39 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.480847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bf14-a64b-4881-961c-ff0968a88d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.480847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676bf14-a64b-4881-961c-ff0968a88d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.481909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676bf14-a64b-4881-961c-ff0968a88d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.483892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676bf14-a64b-4881-961c-ff0968a88d39 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.507759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 866/1748] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:14.507759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.507759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.507759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.511372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] The token cache is being invalidate because project cb0597fc7a444a9c93c3bec3e0d7981b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:14.511673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.522282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3179a843-720b-4e03-ab30-744d7298e8bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:14.530675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:14.531418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 883/1749] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:14 2022] DELETE /identity/v3/projects/cb0597fc7a444a9c93c3bec3e0d7981b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.532134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.532740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821f3e-41fc-483f-921f-529d895af935 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.533070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821f3e-41fc-483f-921f-529d895af935 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.533308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16821f3e-41fc-483f-921f-529d895af935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.554308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:14.573970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-16821f3e-41fc-483f-921f-529d895af935 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:14.574770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-16821f3e-41fc-483f-921f-529d895af935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.603381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 884/1750] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:14.605196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821f3e-41fc-483f-921f-529d895af935 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.615933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-16821f3e-41fc-483f-921f-529d895af935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.682668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 867/1751] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:14.683658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.687618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.706269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157458f8-9e52-443e-809d-d47c79cecb9c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.711700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.712547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.713845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.714302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] PATH_INFO: `/v3/projects/1d6972c2b3d348e4b01c6fc0cce3a040/users/40fab327a3374af58896d75b6e68890e/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.732065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6972c2b3d348e4b01c6fc0cce3a040, user_id=40fab327a3374af58896d75b6e68890e, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.735405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.766650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16821f3e-41fc-483f-921f-529d895af935 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.772835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:14.774248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:14.774772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:14.775258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:14.778057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.853058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:14.855093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:14.879943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 885/1752] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:48:14.881200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.886899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:14.914564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84dfc1-f1f6-42be-8e34-fa1b617611c4 service swift] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:14.924082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 868/1753] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:14 2022] PUT /identity/v3/projects/1d6972c2b3d348e4b01c6fc0cce3a040/users/40fab327a3374af58896d75b6e68890e/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:14.924217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:14.930351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.031594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.042582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.042582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.042582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] PATH_INFO: `/v3/users/8ddfd32a8aa64c6a90cbc149c8818692` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.042582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddfd32a8aa64c6a90cbc149c8818692)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.042582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.078401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d83a1d-7492-4626-aab4-c4aa01671ba7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.086677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf952b-09d6-4a1b-9270-87482516995e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.087379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf952b-09d6-4a1b-9270-87482516995e service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.088662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf952b-09d6-4a1b-9270-87482516995e service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.089157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf952b-09d6-4a1b-9270-87482516995e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.103533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf952b-09d6-4a1b-9270-87482516995e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.105108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf952b-09d6-4a1b-9270-87482516995e service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.117377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 869/1754] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:15.118877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.119147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.119430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.145056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:15.147537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.154561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 870/1755] 10.222.0.95 () {58 vars in 1015 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:15.156164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.157489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.169891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26064a7-7073-4cea-a444-e547ed76f8b8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.176580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5b7ae-b9ad-4211-975d-d4a9d8daaa9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.176580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5b7ae-b9ad-4211-975d-d4a9d8daaa9c service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.176580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5b7ae-b9ad-4211-975d-d4a9d8daaa9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.176580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5b7ae-b9ad-4211-975d-d4a9d8daaa9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.186235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5b7ae-b9ad-4211-975d-d4a9d8daaa9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.188022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5b7ae-b9ad-4211-975d-d4a9d8daaa9c service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.202940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 871/1756] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:15.205487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca8ea-85a6-4a96-8263-4fc4635ea2f9 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.205976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca8ea-85a6-4a96-8263-4fc4635ea2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.206430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ca8ea-85a6-4a96-8263-4fc4635ea2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.232232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-901ca8ea-85a6-4a96-8263-4fc4635ea2f9 None None] MFA Rules not processed for user `790de0d0a3954663b4f2f140517b5ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:15.233467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-901ca8ea-85a6-4a96-8263-4fc4635ea2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.308426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 872/1757] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:15.309930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.310322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.310692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.371403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] MFA Rules not processed for user `40fab327a3374af58896d75b6e68890e`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:15.375166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.498373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddfd32a8aa64c6a90cbc149c8818692'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:15.500862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddfd32a8aa64c6a90cbc149c8818692'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:15.502459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddfd32a8aa64c6a90cbc149c8818692'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:15.533545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddfd32a8aa64c6a90cbc149c8818692'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:15.557300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 873/1758] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:15.558496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.559964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.576536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cff3e-eba3-4788-8228-4e97e48ad714 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.585500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.585500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.585500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.585500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.586107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.598968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.601105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.612727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 874/1759] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:15.614226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.616194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:15.633119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4216259-13d1-4d43-ba48-33ab75efa953 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:15.638817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:15.639565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:15.639858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:15.640801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:15.641676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:15.645615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:15.673502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddfd32a8aa64c6a90cbc149c8818692'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:15.674405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:15.702488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 886/1760] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:14 2022] DELETE /identity/v3/users/8ddfd32a8aa64c6a90cbc149c8818692 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:15.855365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 875/1761] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/projects => generated 379 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:15.861930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:15.952561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e722-de5c-4547-9814-79b4b68da234 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:16.087271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c84b93-a4ee-4628-bacc-eec258c6cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:16.088031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c84b93-a4ee-4628-bacc-eec258c6cf46 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:16.088271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c84b93-a4ee-4628-bacc-eec258c6cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:16.088516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c84b93-a4ee-4628-bacc-eec258c6cf46 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:16.089507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c84b93-a4ee-4628-bacc-eec258c6cf46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:16.091509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c84b93-a4ee-4628-bacc-eec258c6cf46 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:16.239159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 887/1762] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:15 2022] POST /identity/v3/users => generated 296 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:16.245121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:16.271732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:16.278336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:16.278336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:16.305380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0888-a056-4c7c-a60d-0d7d60f4ca61 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:16.330313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] MFA Rules not processed for user `a7a6eb1ae2eb4110b6bd689740769aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:16.331881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:16.353729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:16.357460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:16.357460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:16.357460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:16.357460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:16.377915 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:16.438044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 876/1763] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:16.439223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:16.464482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeec51-0b46-42b9-8082-d7722771a134 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:16.482903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:16.484469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:16.484469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:16.485581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] PATH_INFO: `/v3/projects/9731c383077d49c5b138192ae12f46f7/users/f09623b28d174d088cd02c96b37f9003/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:16.507950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:16.530020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9731c383077d49c5b138192ae12f46f7, user_id=f09623b28d174d088cd02c96b37f9003, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:16.553543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:16.585795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 888/1764] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:16.658776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 877/1765] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:16 2022] PUT /identity/v3/projects/9731c383077d49c5b138192ae12f46f7/users/f09623b28d174d088cd02c96b37f9003/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:16.664296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:16.704227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087a6824-11c4-486a-ad4b-afaf1b9735fc None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:16.925860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:16.926514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:16.926801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:16.927081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:16.936175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:16.941335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:16.987152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 889/1766] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:16.989204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:17.011942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa68496-5865-4e1b-a259-30c8da4fc7df admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:17.028868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6277c65-c19b-4c87-afee-b24d8acde316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:17.031277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6277c65-c19b-4c87-afee-b24d8acde316 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.031668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6277c65-c19b-4c87-afee-b24d8acde316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.033452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6277c65-c19b-4c87-afee-b24d8acde316 admin admin] PATH_INFO: `/v3/projects/9731c383077d49c5b138192ae12f46f7/users/f09623b28d174d088cd02c96b37f9003/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.036911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6277c65-c19b-4c87-afee-b24d8acde316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9731c383077d49c5b138192ae12f46f7, user_id=f09623b28d174d088cd02c96b37f9003, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:17.047793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:17.049628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.054792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6277c65-c19b-4c87-afee-b24d8acde316 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:17.074153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5315-c226-4323-bb39-83c0435451de admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:17.095879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:17.096580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.096916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.097201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] PATH_INFO: `/v3/projects/a6a067ba532f45a38fa761039ac22cd6` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.103856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 878/1767] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:16 2022] PUT /identity/v3/projects/9731c383077d49c5b138192ae12f46f7/users/f09623b28d174d088cd02c96b37f9003/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:17.107436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6a067ba532f45a38fa761039ac22cd6)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:17.108726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:17.116066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.116401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.123814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.198639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] MFA Rules not processed for user `f09623b28d174d088cd02c96b37f9003`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:17.201909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.437297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6a067ba532f45a38fa761039ac22cd6', 'request_id': 'req-48af0994-ebef-486b-b8fa-f2e98a160da3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.446552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6a067ba532f45a38fa761039ac22cd6', 'request_id': 'req-48af0994-ebef-486b-b8fa-f2e98a160da3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.521388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 879/1768] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:17.530228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:17.533190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.589252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6a067ba532f45a38fa761039ac22cd6', 'request_id': 'req-48af0994-ebef-486b-b8fa-f2e98a160da3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.631510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] The token cache is being invalidate because project a6a067ba532f45a38fa761039ac22cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:17.631907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.638314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:17.646792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 890/1769] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:17 2022] DELETE /identity/v3/projects/a6a067ba532f45a38fa761039ac22cd6 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:17.650864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:17.662295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.777157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78309-9567-4849-adc4-806c1d022bf2 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:17.836885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:17.837875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.838335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.838768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.841210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:17.934037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af0994-ebef-486b-b8fa-f2e98a160da3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:17.941807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:17.943144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:17.943763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:17.944261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] PATH_INFO: `/v3/users/a0030d28a49c4279ae87e599e762ab75` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:17.946056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0030d28a49c4279ae87e599e762ab75)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:17.948391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:18.000309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:18.004860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:18.068379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 880/1770] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:18.417362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:18.430638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:18.436460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0030d28a49c4279ae87e599e762ab75'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.438138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0030d28a49c4279ae87e599e762ab75'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.442844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0030d28a49c4279ae87e599e762ab75'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.467861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a025ac-88f8-4f41-ab2e-5538901f24dc service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:18.476635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0030d28a49c4279ae87e599e762ab75'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.478090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:18.478338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:18.478816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:18.479451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:18.481721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:18.599595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0030d28a49c4279ae87e599e762ab75'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:18.639257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 891/1771] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:17 2022] DELETE /identity/v3/users/a0030d28a49c4279ae87e599e762ab75 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:18.715297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:18.716889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a6f9c-fb2c-4844-83e9-eb327812f1dc service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:18.741128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 881/1772] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:18.942289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:18.943921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:19.311984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831583a-f330-4581-b6e6-11f2ac0377e0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:19.321081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:19.323377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.324302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.325314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] PATH_INFO: `/v3/projects/7156f11395a84d78b95421302128a1f2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.336251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7156f11395a84d78b95421302128a1f2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:19.344362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:19.730172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7156f11395a84d78b95421302128a1f2', 'request_id': 'req-39953a78-b45d-4cd1-b649-cdbe41e05894'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:19.744626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7156f11395a84d78b95421302128a1f2', 'request_id': 'req-39953a78-b45d-4cd1-b649-cdbe41e05894'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:19.781060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c32c1-51df-4ec7-9a07-7d5c48141ac4 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.782308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c32c1-51df-4ec7-9a07-7d5c48141ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.782938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c32c1-51df-4ec7-9a07-7d5c48141ac4 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.785023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 882/1773] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:48:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:19.802352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:19.815993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.816285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.816562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:19.873872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:19.880671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7156f11395a84d78b95421302128a1f2', 'request_id': 'req-39953a78-b45d-4cd1-b649-cdbe41e05894'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:19.901724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:19.909614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] The token cache is being invalidate because project 7156f11395a84d78b95421302128a1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:19.909614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:19.922942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-39953a78-b45d-4cd1-b649-cdbe41e05894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:19.924718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 892/1774] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:18 2022] DELETE /identity/v3/projects/7156f11395a84d78b95421302128a1f2 => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:19.931542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:19.932034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:19.932324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.031580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:20.032803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:20.187928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 883/1775] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:20.195888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:20.197965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:20.222319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 893/1776] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:20.223464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:20.226262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:20.246947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5957ec-41c7-418f-806a-d9c6bc9f6801 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:20.263992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:20.263992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.263992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.263992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] PATH_INFO: `/v3/projects/d92cf8cc023544ed99d2c591f1505426` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.264300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92cf8cc023544ed99d2c591f1505426)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:20.264993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:20.275612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b215-3580-4ef6-9002-c16da5a56b27 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:20.302831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716b88de-bb35-4525-9e44-c5d57e814ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:20.303472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b88de-bb35-4525-9e44-c5d57e814ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.304323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b88de-bb35-4525-9e44-c5d57e814ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.304709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b88de-bb35-4525-9e44-c5d57e814ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.324264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b88de-bb35-4525-9e44-c5d57e814ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:20.325911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716b88de-bb35-4525-9e44-c5d57e814ed0 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:20.347703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 894/1777] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:20.351837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.352795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.355705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.379335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:20.380459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:20.392609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 895/1778] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:20.397267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:20.407941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665eb2d-aec3-4322-aca1-8da8ecb8d86f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:20.414369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:20.415952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.416327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.416724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.417948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:20.418279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:20.419928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:20.469461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 896/1779] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:20.473989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:20.493971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad30e1-fe6f-4a54-83df-23987300539f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:20.505279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:20.505962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.506243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.506514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.510165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:20.512666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:20.771505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 897/1780] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:20 2022] POST /identity/v3/projects => generated 355 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:20.773105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92cf8cc023544ed99d2c591f1505426', 'request_id': 'req-f5311bdc-90ef-43e0-a533-deaaafe06826'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:20.776089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:20.810751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92cf8cc023544ed99d2c591f1505426', 'request_id': 'req-f5311bdc-90ef-43e0-a533-deaaafe06826'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:20.810751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92cf8cc023544ed99d2c591f1505426', 'request_id': 'req-f5311bdc-90ef-43e0-a533-deaaafe06826'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:20.915987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5f10e-54d9-4778-806e-5651d86da3b2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:20.922636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:20.923372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:20.923804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:20.924165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:20.924885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:20.927089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.097892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] The token cache is being invalidate because project d92cf8cc023544ed99d2c591f1505426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:21.097892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:21.098618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f5311bdc-90ef-43e0-a533-deaaafe06826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:21.100477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 884/1781] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:20 2022] DELETE /identity/v3/projects/d92cf8cc023544ed99d2c591f1505426 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:21.106965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3352506-0ff6-4734-84b2-7c1bac226a78 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.107507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3352506-0ff6-4734-84b2-7c1bac226a78 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.107930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3352506-0ff6-4734-84b2-7c1bac226a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.130254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b3352506-0ff6-4734-84b2-7c1bac226a78 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.133417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b3352506-0ff6-4734-84b2-7c1bac226a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.147217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 885/1782] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:21.157711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.158293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.158731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.206336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:21.212088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.230488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 886/1783] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:21.235899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.246331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb39de1-ddb5-48f4-81c8-b70485829491 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.251134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.252048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.252327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.252757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.253423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:21.253726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.255465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.270572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 887/1784] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:21.276684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.304056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7c622-c412-40e7-bbea-e54c4f39d44a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.324986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.326107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.326772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.327548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.329023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.333227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.398535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 898/1785] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:20 2022] POST /identity/v3/users => generated 278 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:21.406933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.422770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:21.445724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05575c5c-85eb-4625-a6be-bd3c22400a78 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.451679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.452509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.452925 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.453337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.454403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.456653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.477622 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 899/1786] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:21.482208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.495394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe79a0-6857-43b1-ac14-8c4b4ad30a35 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.502516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.503590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.504041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.504458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.505333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.508207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.521592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 900/1787] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:21.527119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:21.553799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644bc8b-3cda-4cb2-a342-65bbddead956 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:21.567028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d82bc0-4fb1-4890-b9be-25dd545c34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:21.567736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82bc0-4fb1-4890-b9be-25dd545c34c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:21.574272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82bc0-4fb1-4890-b9be-25dd545c34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:21.574641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82bc0-4fb1-4890-b9be-25dd545c34c4 admin admin] PATH_INFO: `/v3/projects/59cc82d22ca748ea8869f961ddac6821/users/34a5b35f1fed4f57a084fc2bf75916d1/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:21.595741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d82bc0-4fb1-4890-b9be-25dd545c34c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cc82d22ca748ea8869f961ddac6821, user_id=34a5b35f1fed4f57a084fc2bf75916d1, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:21.599303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d82bc0-4fb1-4890-b9be-25dd545c34c4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:21.790695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 888/1788] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/projects => generated 385 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:21.796814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.010788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630c7ea-6404-4da2-8af9-ad48449d5e41 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.029597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.030393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.031432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.032830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.033510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.045881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 901/1789] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:21 2022] PUT /identity/v3/projects/59cc82d22ca748ea8869f961ddac6821/users/34a5b35f1fed4f57a084fc2bf75916d1/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:22.047872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.057697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.058010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.058280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.104936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] MFA Rules not processed for user `34a5b35f1fed4f57a084fc2bf75916d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:22.115803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:22.209359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 889/1790] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:21 2022] POST /identity/v3/users => generated 293 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:22.211582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.211935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 902/1791] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:22.213122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.280572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323c6d-6582-46f3-809d-8ccb69454d1c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.401809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.402707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.403118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.403417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.404305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.407360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.407893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd65d8-20ec-41c6-ada5-3a4d2d31b663 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.428995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a10ad9-d287-405f-a002-4c8248613928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.430761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a10ad9-d287-405f-a002-4c8248613928 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.431239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a10ad9-d287-405f-a002-4c8248613928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.431714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a10ad9-d287-405f-a002-4c8248613928 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.433708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a10ad9-d287-405f-a002-4c8248613928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.436545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a10ad9-d287-405f-a002-4c8248613928 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.441276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 890/1792] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:22.445722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.473175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9220-24e0-4c9b-acbe-aeb0660597a9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.494666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.495309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.495592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.496046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.497111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.499081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.515530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 891/1793] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:22.517088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.529379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4496644-ca77-4f35-b274-7a06b64ab72c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.535038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.551879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.551879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.551879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] PATH_INFO: `/v3/projects/057093ff78bd42ea813ac6746f6d9eb4/users/158de5c47e6c41f08d7921513e01e4a5/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.555193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=057093ff78bd42ea813ac6746f6d9eb4, user_id=158de5c47e6c41f08d7921513e01e4a5, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.558546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.624135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:22.669892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 892/1794] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:22 2022] PUT /identity/v3/projects/057093ff78bd42ea813ac6746f6d9eb4/users/158de5c47e6c41f08d7921513e01e4a5/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:22.678760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 903/1795] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/projects => generated 355 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:22.683936 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:22.690749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.701663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.701663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.729840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] MFA Rules not processed for user `158de5c47e6c41f08d7921513e01e4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:22.731340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:22.784239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328e9b9-f49a-4bdc-b66c-1f23a1301b2c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:22.908331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:22.909799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:22.910465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:22.910887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:22.911817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:22.915651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:22.975337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 904/1796] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:22.978400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.002951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df0555-81f1-4411-9a6a-a14190a7b5d7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.010100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.010791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.011137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.011465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.012868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.015430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.234677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 893/1797] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/users => generated 284 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:23.235673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.237211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 905/1798] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:22 2022] POST /identity/v3/projects => generated 385 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:23.242771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.262071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564982d-e5e3-4f3f-98e1-85b42b7bd3cd admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.372947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.386728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.386728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.386728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.386728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.386728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.387583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07da9d-267b-4e03-b34a-d1733a6045f8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.400759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.402013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.402403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.402868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.403610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.406007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.407554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 894/1799] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:23.412990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.439162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e96a85-be61-48eb-a88f-d77ba8efb7bf admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.480135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.481041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.481435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.482045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] PATH_INFO: `/v3/projects/340161801dca407a83b56179ad9270c3/users/8def7f5b7e284b5bae5e6c7f72466d5b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.510572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340161801dca407a83b56179ad9270c3, user_id=8def7f5b7e284b5bae5e6c7f72466d5b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.516300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.809896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 895/1800] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:23 2022] PUT /identity/v3/projects/340161801dca407a83b56179ad9270c3/users/8def7f5b7e284b5bae5e6c7f72466d5b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:23.813563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.814109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 906/1801] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:23 2022] POST /identity/v3/users => generated 293 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:23.819196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.847216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f420d482-3445-40c9-9d9f-1a02e667f36b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.915018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3a198-a312-4496-b6b7-825b07bcf5b1 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.920944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.921745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.922203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.922611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.923505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.925268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.936889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 896/1802] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:23.940432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.940980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.941103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.941372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.941652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.942586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.946988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.951495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3f0066-8d99-41d6-8a92-b41e3b24c580 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.955472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 907/1803] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:23.959642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:23.970584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd31c39-ba2f-4c3c-8d6e-9d1e4aadb2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.971512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31c39-ba2f-4c3c-8d6e-9d1e4aadb2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.971804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31c39-ba2f-4c3c-8d6e-9d1e4aadb2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.972089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd31c39-ba2f-4c3c-8d6e-9d1e4aadb2c1 admin admin] PATH_INFO: `/v3/projects/340161801dca407a83b56179ad9270c3/users/8def7f5b7e284b5bae5e6c7f72466d5b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.974371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd31c39-ba2f-4c3c-8d6e-9d1e4aadb2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=340161801dca407a83b56179ad9270c3, user_id=8def7f5b7e284b5bae5e6c7f72466d5b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.977797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd31c39-ba2f-4c3c-8d6e-9d1e4aadb2c1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:23.981701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ed193-2ebb-4100-8d57-7e02545576c4 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:23.983697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:23.984406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:23.985104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:23.985104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:23.985915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:23.987659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:24.003506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 897/1804] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:23 2022] PUT /identity/v3/projects/340161801dca407a83b56179ad9270c3/users/8def7f5b7e284b5bae5e6c7f72466d5b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:24.003603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 908/1805] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:24.003682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.003911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.004271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.006753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.025815 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a7c2d-1cc7-4717-8f35-a686c73e6ab9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.055927 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] MFA Rules not processed for user `8def7f5b7e284b5bae5e6c7f72466d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:24.057427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.141683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.142416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.142739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.142972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] PATH_INFO: `/v3/projects/ee0416cde1a4481b88a88f1010ecce97/users/fdddee0a7b1a483cb3dd610038f58c66/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.167360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 898/1806] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:24.189570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.189570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.197813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0416cde1a4481b88a88f1010ecce97, user_id=fdddee0a7b1a483cb3dd610038f58c66, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:24.201839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:24.275855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983079d-a7cb-42c7-9689-4c6c9f6ee7ba None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.280137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc619824-4298-48a5-8178-df29a71f7ec6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.280770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc619824-4298-48a5-8178-df29a71f7ec6 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.281055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc619824-4298-48a5-8178-df29a71f7ec6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.281331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc619824-4298-48a5-8178-df29a71f7ec6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.292058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc619824-4298-48a5-8178-df29a71f7ec6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:24.293570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc619824-4298-48a5-8178-df29a71f7ec6 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:24.312371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 899/1807] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:24.597611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 909/1808] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:24 2022] PUT /identity/v3/projects/ee0416cde1a4481b88a88f1010ecce97/users/fdddee0a7b1a483cb3dd610038f58c66/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:24.616516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.616516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.616516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.649450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] MFA Rules not processed for user `fdddee0a7b1a483cb3dd610038f58c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:24.650658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:24.789187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 900/1809] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:24.791054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.799842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:24.887892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6f734-e39a-47f2-835d-426ae398c1ad admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.894900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0c82d-2c09-4441-bc90-98518500d829 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:24.899257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.899939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.900342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.900622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.915989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:24.919035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:24.919035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:24.919035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:24.919035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:24.919843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:24.988287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:24.991608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.004130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 910/1810] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:24 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:25.007223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 901/1811] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:25.008960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.105635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01ec18-27e6-4b0b-8213-c0a0791a10ff admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.110321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.111028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.111402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.111829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.112737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.115381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.454994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 911/1812] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:25 2022] POST /identity/v3/users => generated 300 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:25.455172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.471010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae15991-e17c-441a-ac51-929c68f499fb service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.479582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.480933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.480933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.480933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.481408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.483301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.497828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 902/1813] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:25.499592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.510208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f02f55-89e1-4f8f-9e2c-d122c65b91e6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.518736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.520266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.520755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.521234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] PATH_INFO: `/v3/projects/70ddb2b61dc34dd198f2e3c96790b0cd/users/88913f7c7516409c84485b4adbd69ec6/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.543636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ddb2b61dc34dd198f2e3c96790b0cd, user_id=88913f7c7516409c84485b4adbd69ec6, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.547274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.708457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 912/1814] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:25 2022] PUT /identity/v3/projects/70ddb2b61dc34dd198f2e3c96790b0cd/users/88913f7c7516409c84485b4adbd69ec6/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:25.712638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.722867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a82fd4-103d-434c-88ef-1fff016d7da7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.801712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c1ab1-b2d3-4d90-95b6-1c2af7fd0990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.802488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1ab1-b2d3-4d90-95b6-1c2af7fd0990 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.803020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1ab1-b2d3-4d90-95b6-1c2af7fd0990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.803392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c1ab1-b2d3-4d90-95b6-1c2af7fd0990 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.805545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c1ab1-b2d3-4d90-95b6-1c2af7fd0990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.807636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c1ab1-b2d3-4d90-95b6-1c2af7fd0990 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.824000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 903/1815] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:25.827539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:25.839405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9c685-3bc3-4016-991d-f489901e6b16 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:25.844872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:25.845789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.846115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.846391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] PATH_INFO: `/v3/projects/70ddb2b61dc34dd198f2e3c96790b0cd/users/88913f7c7516409c84485b4adbd69ec6/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.848370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ddb2b61dc34dd198f2e3c96790b0cd, user_id=88913f7c7516409c84485b4adbd69ec6, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:25.851252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:25.863151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 913/1816] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:25 2022] PUT /identity/v3/projects/70ddb2b61dc34dd198f2e3c96790b0cd/users/88913f7c7516409c84485b4adbd69ec6/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:25.874069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:25.874622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:25.874908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:25.915859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] MFA Rules not processed for user `88913f7c7516409c84485b4adbd69ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:25.916956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:25.999421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 904/1817] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:26.010575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:26.065895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9ec51-cd72-4fba-b4f4-6d103449ce57 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:26.070658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc35dc-f465-402f-b25b-eb43a370e267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:26.071318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc35dc-f465-402f-b25b-eb43a370e267 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:26.071602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc35dc-f465-402f-b25b-eb43a370e267 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:26.071878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc35dc-f465-402f-b25b-eb43a370e267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:26.081279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc35dc-f465-402f-b25b-eb43a370e267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:26.082771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc35dc-f465-402f-b25b-eb43a370e267 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:26.100606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 914/1818] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:26.266390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:26.267797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:26.333569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfc795-28e1-497c-a050-716880c8d088 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:26.342345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:26.342976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:26.343254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:26.343524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] PATH_INFO: `/v3/users/045833926c2c42aeaae188844232431e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:26.344669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045833926c2c42aeaae188844232431e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:26.346649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:26.530790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:26.617610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045833926c2c42aeaae188844232431e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:26.618442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045833926c2c42aeaae188844232431e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:26.619295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045833926c2c42aeaae188844232431e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:26.637489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045833926c2c42aeaae188844232431e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:26.714218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:26.770760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045833926c2c42aeaae188844232431e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:26.783874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 905/1819] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:26 2022] DELETE /identity/v3/users/045833926c2c42aeaae188844232431e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:26.788505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:26.789000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:26.789109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:26.807675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:26.808873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:26.869714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 915/1820] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:26.879718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:26.881157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:26.940419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf14236-5845-46db-ab93-2d1056f84e74 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:26.944952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:26.945630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:26.945937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:26.947735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:26.956437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:26.957903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:26.968178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 906/1821] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:27.558541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:27.560185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:27.578493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b788ffd-3504-47be-9815-8f86ecad6cfa None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:27.588584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:27.589405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:27.589692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:27.589995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] PATH_INFO: `/v3/projects/df624d67dc314aa68734ed7d5e8391be` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:27.591150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=df624d67dc314aa68734ed7d5e8391be)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:27.593545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:27.739724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df624d67dc314aa68734ed7d5e8391be', 'request_id': 'req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.749154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df624d67dc314aa68734ed7d5e8391be', 'request_id': 'req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.788267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:27.790637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:27.848849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205df55-ee55-4532-95c9-c941334335b5 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:27.873822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df624d67dc314aa68734ed7d5e8391be', 'request_id': 'req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.885993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] The token cache is being invalidate because project df624d67dc314aa68734ed7d5e8391be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:27.886296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.886980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:27.888492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 916/1822] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:27 2022] DELETE /identity/v3/projects/df624d67dc314aa68734ed7d5e8391be => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:27.892360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:27.893915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:27.901216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:27.902078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:27.904701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:27.904701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:27.904701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:27.962757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5dffa-0d2d-412a-8a09-ef09c79a2edb admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:27.967506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:27.973501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:27.973501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:27.973501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] PATH_INFO: `/v3/users/40fab327a3374af58896d75b6e68890e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:27.973501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fab327a3374af58896d75b6e68890e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:27.973946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:27.974036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:27.974123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:27.983359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 907/1823] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:28.173135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fab327a3374af58896d75b6e68890e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.173840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fab327a3374af58896d75b6e68890e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.174469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fab327a3374af58896d75b6e68890e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.186219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fab327a3374af58896d75b6e68890e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.279722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fab327a3374af58896d75b6e68890e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:28.294236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 917/1824] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:27 2022] DELETE /identity/v3/users/40fab327a3374af58896d75b6e68890e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:28.912350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:28.932463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6145d-05f9-4f55-a7cd-7b5ad2b50254 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:29.037517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:29.038201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:29.038484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:29.038759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] PATH_INFO: `/v3/projects/1d6972c2b3d348e4b01c6fc0cce3a040` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:29.039923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6972c2b3d348e4b01c6fc0cce3a040)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:29.041849 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:29.243382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6972c2b3d348e4b01c6fc0cce3a040', 'request_id': 'req-91800cde-9b6e-4760-ae6a-2b5717a8c995'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.255473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6972c2b3d348e4b01c6fc0cce3a040', 'request_id': 'req-91800cde-9b6e-4760-ae6a-2b5717a8c995'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.266969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6972c2b3d348e4b01c6fc0cce3a040', 'request_id': 'req-91800cde-9b6e-4760-ae6a-2b5717a8c995'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.353896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] The token cache is being invalidate because project 1d6972c2b3d348e4b01c6fc0cce3a040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:29.354222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.354868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.356543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 908/1825] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:28 2022] DELETE /identity/v3/projects/1d6972c2b3d348e4b01c6fc0cce3a040 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:29.360674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:29.362174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:29.375994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb53d3a-a6d2-4375-845c-78505d16ffa2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:29.437432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:29.438037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:29.438372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:29.438653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] PATH_INFO: `/v3/users/f09623b28d174d088cd02c96b37f9003` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:29.440364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09623b28d174d088cd02c96b37f9003)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:29.441796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:29.634082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:29.647874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09623b28d174d088cd02c96b37f9003'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.648650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09623b28d174d088cd02c96b37f9003'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.649301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09623b28d174d088cd02c96b37f9003'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.660913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09623b28d174d088cd02c96b37f9003'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.765285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3f5551fb-2118-435a-9b18-328fc023fbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09623b28d174d088cd02c96b37f9003'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:29.779426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 918/1826] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:29 2022] DELETE /identity/v3/users/f09623b28d174d088cd02c96b37f9003 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:30.511500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:30.512648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:30.526417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91800cde-9b6e-4760-ae6a-2b5717a8c995 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:30.601928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:30.601928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.601928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.601928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] PATH_INFO: `/v3/projects/9731c383077d49c5b138192ae12f46f7` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.602328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9731c383077d49c5b138192ae12f46f7)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:30.602328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:30.710228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9731c383077d49c5b138192ae12f46f7', 'request_id': 'req-f21d3697-0c09-4a11-ab12-ed64119697dc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:30.716910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9731c383077d49c5b138192ae12f46f7', 'request_id': 'req-f21d3697-0c09-4a11-ab12-ed64119697dc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:30.722497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9731c383077d49c5b138192ae12f46f7', 'request_id': 'req-f21d3697-0c09-4a11-ab12-ed64119697dc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:30.800827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] The token cache is being invalidate because project 9731c383077d49c5b138192ae12f46f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:30.801120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:30.801759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f21d3697-0c09-4a11-ab12-ed64119697dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:30.803311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 909/1827] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:30 2022] DELETE /identity/v3/projects/9731c383077d49c5b138192ae12f46f7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:30.805717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:30.809330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.809645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.809963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.829371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:30.830625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:30.893749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 919/1828] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:30.902935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.908100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.908100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.925373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:30.927017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:30.935651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 910/1829] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:30.939965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:30.953526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19cb1e-e2ef-4961-b1be-0330037ba3e5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:30.959170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:30.960031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:30.960312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:30.960634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:30.961288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:30.961600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:30.964458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:30.981108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 920/1830] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:30.982483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:30.993511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446871a-81a3-420d-871b-a4d36f0b45f1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:30.998660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:30.999278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.000717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.000717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.000717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.002427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.118453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 911/1831] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:30 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:31.122714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.131391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0f798-0050-4372-8f85-c3af81730409 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.193684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.194540 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.195262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.195262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.195479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.197937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.252770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:31.319469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 921/1832] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:31.324172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.334469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fa4bf-ceb4-44ce-b5c7-3da57f6fd601 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.344193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.346685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.346685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.346685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.346685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.347704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.358170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 912/1833] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:31.362224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.372398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bec22-f097-4c31-ab09-3777e1c6b154 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.377483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00e7f-b49e-4f43-b69f-2d84ae659a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.378129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00e7f-b49e-4f43-b69f-2d84ae659a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.378418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00e7f-b49e-4f43-b69f-2d84ae659a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.378694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00e7f-b49e-4f43-b69f-2d84ae659a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.381071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00e7f-b49e-4f43-b69f-2d84ae659a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.381071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00e7f-b49e-4f43-b69f-2d84ae659a85 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.392307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 922/1834] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:31.396714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.410222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11292d10-6ee3-4a5d-ae46-20f14b299ae1 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.413167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.413942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.414251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.414595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] PATH_INFO: `/v3/projects/969c87cae5c8429583c9f045913c1e75/users/43a1ba81ea39482f8e26686d3d02981e/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.429952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] RBAC: Authorizing `identity:create_grant(project_id=969c87cae5c8429583c9f045913c1e75, user_id=43a1ba81ea39482f8e26686d3d02981e, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.433148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.554462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 913/1835] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:31 2022] PUT /identity/v3/projects/969c87cae5c8429583c9f045913c1e75/users/43a1ba81ea39482f8e26686d3d02981e/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:31.566918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.567208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.567486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.595396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] MFA Rules not processed for user `43a1ba81ea39482f8e26686d3d02981e`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:31.596631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:31.666480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 923/1836] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:31.670701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.735852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7dda9-3793-4e76-934c-d73a08a3a77b admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.741634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.742357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.742640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.742914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.743583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.745502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:31.864562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 914/1837] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:31.868478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:31.879996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1c9b9-d0c0-4524-a53a-67eb3eddc2eb None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:31.939477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:31.940096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:31.940372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:31.940659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:31.941312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:31.943291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.037896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 924/1838] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:31 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:32.038893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.050459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e731ee0-da0c-4ded-896b-fe5ec7131563 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.055414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.056113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.056330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.056603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.057247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.058903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.075629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 915/1839] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:32.091268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.101589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198469d1-62b1-410d-95a1-73a8a64d7d3c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.106201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.106872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.107151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.107433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] PATH_INFO: `/v3/projects/6cde7b0fe6df4a7680abcc2c6e928aa9/users/2b29a568e377413096635c02df6ab297/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.125167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cde7b0fe6df4a7680abcc2c6e928aa9, user_id=2b29a568e377413096635c02df6ab297, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.127999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.154750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:32.225377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 925/1840] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:32 2022] PUT /identity/v3/projects/6cde7b0fe6df4a7680abcc2c6e928aa9/users/2b29a568e377413096635c02df6ab297/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:32.229464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.254950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dabf1-2034-4885-ba69-8a73eecdfa04 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.405102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fb6cb-c622-422e-bb2c-0ba1404fb9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.406055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fb6cb-c622-422e-bb2c-0ba1404fb9df admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.406674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fb6cb-c622-422e-bb2c-0ba1404fb9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.407065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fb6cb-c622-422e-bb2c-0ba1404fb9df admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.407907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fb6cb-c622-422e-bb2c-0ba1404fb9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.409510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fb6cb-c622-422e-bb2c-0ba1404fb9df admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.430262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 916/1841] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:32.431949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.443817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e5de9-b120-4bb2-8088-01c8b5db0bb1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:32.450062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:32.450801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.451084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.451362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] PATH_INFO: `/v3/projects/6cde7b0fe6df4a7680abcc2c6e928aa9/users/2b29a568e377413096635c02df6ab297/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.455545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cde7b0fe6df4a7680abcc2c6e928aa9, user_id=2b29a568e377413096635c02df6ab297, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:32.459401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:32.484292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:32.484441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 926/1842] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:32 2022] PUT /identity/v3/projects/6cde7b0fe6df4a7680abcc2c6e928aa9/users/2b29a568e377413096635c02df6ab297/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:32.484579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:32.484858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:32.525952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] MFA Rules not processed for user `2b29a568e377413096635c02df6ab297`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:32.527650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:32.642862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 917/1843] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:32.979186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:32.981050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:33.061895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669436f9-7d11-40fb-89ac-7cb9a86a3a53 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:33.069944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:33.077149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:33.077149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:33.077149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:33.092339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:33.094038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:33.124946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 927/1844] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:33.490083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:33.506011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0798e-7d4d-42d5-a173-3ea40524f0fe None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:33.515577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c377-b6f0-4589-b235-8ef3de8d1a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:33.516217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c377-b6f0-4589-b235-8ef3de8d1a60 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:33.516497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c377-b6f0-4589-b235-8ef3de8d1a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:33.516770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c377-b6f0-4589-b235-8ef3de8d1a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:33.650854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8c377-b6f0-4589-b235-8ef3de8d1a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:33.662847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8c377-b6f0-4589-b235-8ef3de8d1a60 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:33.674430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 918/1845] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:34.293278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:34.392657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa218f7-c8b5-4104-b0dc-0b932ba4486a service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:34.403519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:34.404310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:34.404601 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:34.404879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] PATH_INFO: `/v3/users/43a1ba81ea39482f8e26686d3d02981e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:34.408616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a1ba81ea39482f8e26686d3d02981e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:34.414160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:34.700313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a1ba81ea39482f8e26686d3d02981e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.701972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a1ba81ea39482f8e26686d3d02981e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.703342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a1ba81ea39482f8e26686d3d02981e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.726668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a1ba81ea39482f8e26686d3d02981e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.825711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a1ba81ea39482f8e26686d3d02981e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:34.848194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 928/1846] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:34 2022] DELETE /identity/v3/users/43a1ba81ea39482f8e26686d3d02981e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:34.848917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:34.849519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:34.849836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:34.890546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:34.891993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:35.003651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 919/1847] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:35.118991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:35.121875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:35.216023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b3143-b1d4-4318-be21-cc2c300af1e2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:35.227756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0c147-3269-40a3-a66d-7c10859cbcf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:35.229030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c147-3269-40a3-a66d-7c10859cbcf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:35.229703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c147-3269-40a3-a66d-7c10859cbcf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:35.231630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0c147-3269-40a3-a66d-7c10859cbcf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:35.262590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c147-3269-40a3-a66d-7c10859cbcf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:35.268071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0c147-3269-40a3-a66d-7c10859cbcf4 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:35.290412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 929/1848] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:35.385433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.595331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:35.893274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:35.896969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.016677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3dc42-801a-4c0d-8e3d-00f4fa8e9e84 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.021464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.022522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.023002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.023617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.026434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.104118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:36.107471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f82bca-6910-4ca8-9628-f3ea0506409a service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:36.128662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 920/1849] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:36.241610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f43c-94f0-4b67-b305-d0620a57053b None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.242132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f43c-94f0-4b67-b305-d0620a57053b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.242506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f43c-94f0-4b67-b305-d0620a57053b None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.244497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 930/1850] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:48:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:48:36.533280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.533280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.533280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.533280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:36.533280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.533280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 921/1851] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:36.534326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034f43c-94f0-4b67-b305-d0620a57053b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:36.534326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a034f43c-94f0-4b67-b305-d0620a57053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.534326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034f43c-94f0-4b67-b305-d0620a57053b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.535627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.535627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.535627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.535627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.536931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:36.536931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:36.536931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 931/1852] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:36.718298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:36.720622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:36.755926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaa042-0bb2-4b0f-834c-7d461b649aef None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:36.762382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:36.763897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:36.765343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:36.765872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] PATH_INFO: `/v3/projects/969c87cae5c8429583c9f045913c1e75` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:36.767351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] RBAC: Authorizing `identity:delete_project(project_id=969c87cae5c8429583c9f045913c1e75)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:36.779136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.135258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969c87cae5c8429583c9f045913c1e75', 'request_id': 'req-7c34d156-fe27-48a8-ac02-67b8579652af'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.142369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969c87cae5c8429583c9f045913c1e75', 'request_id': 'req-7c34d156-fe27-48a8-ac02-67b8579652af'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.148667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969c87cae5c8429583c9f045913c1e75', 'request_id': 'req-7c34d156-fe27-48a8-ac02-67b8579652af'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.341314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] The token cache is being invalidate because project 969c87cae5c8429583c9f045913c1e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:37.341314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.341314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c34d156-fe27-48a8-ac02-67b8579652af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.342499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:37.342768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 922/1853] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:36 2022] DELETE /identity/v3/projects/969c87cae5c8429583c9f045913c1e75 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:37.358951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa24b1f-b41c-442a-a684-25299f5dd258 service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:37.476636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:37.477301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.477586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.481212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] PATH_INFO: `/v3/users/2b29a568e377413096635c02df6ab297` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.495281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b29a568e377413096635c02df6ab297)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:37.497583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:37.613151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191865-7e0e-4dca-812b-2601e920dbe7 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.613756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191865-7e0e-4dca-812b-2601e920dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.618479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87191865-7e0e-4dca-812b-2601e920dbe7 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.618479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 923/1854] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:48:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 03:48:37.654931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:37.655358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:37.655693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:37.676742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:37.678405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:37.834106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 924/1855] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:48:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:37.845128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b29a568e377413096635c02df6ab297'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.848922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b29a568e377413096635c02df6ab297'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.851883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b29a568e377413096635c02df6ab297'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:37.892724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b29a568e377413096635c02df6ab297'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.023571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b29a568e377413096635c02df6ab297'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.046057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 932/1856] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:37 2022] DELETE /identity/v3/users/2b29a568e377413096635c02df6ab297 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:38.059295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.060808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.075415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fae53-eeca-43a9-b98a-47694cc5a8e6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.186513 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.187158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.187479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.187751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.189474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.201791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.203498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d428e6-447a-44fe-a57c-dc629db12594 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.213906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 925/1857] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:38.546009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:38.548095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:38.616064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedddb6c-3c55-417f-aac5-066726f983bc admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:38.622295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:38.622969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:38.623260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:38.623530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] PATH_INFO: `/v3/projects/6cde7b0fe6df4a7680abcc2c6e928aa9` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:38.624693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cde7b0fe6df4a7680abcc2c6e928aa9)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:38.626674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:38.883344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cde7b0fe6df4a7680abcc2c6e928aa9', 'request_id': 'req-be578568-5ce2-4cc7-9926-5edcd63b73e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:38.889750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cde7b0fe6df4a7680abcc2c6e928aa9', 'request_id': 'req-be578568-5ce2-4cc7-9926-5edcd63b73e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.097159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cde7b0fe6df4a7680abcc2c6e928aa9', 'request_id': 'req-be578568-5ce2-4cc7-9926-5edcd63b73e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.135520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] The token cache is being invalidate because project 6cde7b0fe6df4a7680abcc2c6e928aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:39.135832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.136530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-be578568-5ce2-4cc7-9926-5edcd63b73e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:39.139627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 933/1858] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:38 2022] DELETE /identity/v3/projects/6cde7b0fe6df4a7680abcc2c6e928aa9 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:39.145040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.146106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.146593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.173756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:39.175676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:39.272632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 926/1859] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:39.280337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.281836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.282136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.306176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:39.307652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:39.321531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 934/1860] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:39.323561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.333994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8ccd7-b0ef-4fbd-afb9-7df9980dabda None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.341241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.342171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.345287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.345287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.345287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:39.345595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.347611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.365813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 927/1861] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:39.380465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.388976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b71bd7-3503-42b4-a4ce-7247a1bd2ada None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.394665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.395434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.396077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.396456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.397222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.399315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.630972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 935/1862] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:39 2022] POST /identity/v3/projects => generated 377 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:39.635569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.645478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475197ef-30d5-472e-b6f4-2c7c2ebc5084 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.711538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.712259 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.714488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.714785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.715447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.717395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.793103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 928/1863] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:39 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:39.799370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.811598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca31764-9081-4949-9945-1144e085f32f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.830739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.830739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.830739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.830739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.831080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.831080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.833073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 936/1864] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:39.837292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.850525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1592d91-86bd-4651-a4b1-a02ee14e8dda admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.858473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281492c-c42a-4613-ac86-de25888987e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.859096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281492c-c42a-4613-ac86-de25888987e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.859380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281492c-c42a-4613-ac86-de25888987e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.859654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281492c-c42a-4613-ac86-de25888987e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.860310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281492c-c42a-4613-ac86-de25888987e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.861969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281492c-c42a-4613-ac86-de25888987e7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.873602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 929/1865] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:39.877830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:39.888406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f3fd-1509-48b2-96ca-f80d0625c88a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:39.893014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:39.893659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:39.901823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:39.901823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] PATH_INFO: `/v3/projects/7d9fae069df14a1ea0d76f9c227f0acb/users/a923608970be4d8a84789461ce3953f3/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:39.909440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9fae069df14a1ea0d76f9c227f0acb, user_id=a923608970be4d8a84789461ce3953f3, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:39.912206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:39.955213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:40.019679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 937/1866] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:39 2022] PUT /identity/v3/projects/7d9fae069df14a1ea0d76f9c227f0acb/users/a923608970be4d8a84789461ce3953f3/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:40.031081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.031399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.031654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.063895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] MFA Rules not processed for user `a923608970be4d8a84789461ce3953f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:40.065685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:40.183136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 930/1867] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:40.183830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.262455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e04889a-7586-4ab1-8dbd-4129ae795cc8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.267802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.269343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.269343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.269343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.269872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.272068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.454668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.455329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 938/1868] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:40 2022] POST /identity/v3/projects => generated 377 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:40.469616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e999a92-c385-4cbc-9aa0-b5151d5218e7 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.554615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.555268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.555553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.555834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.556485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.558625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.698104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 931/1869] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:40 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:40.702573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.713580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecb0ed-6dee-4913-a668-e10f7b21b82a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.718331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.718933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.719282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.719560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.720364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.722008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.732905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 939/1870] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:40.737491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.747894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ea0a0-64bd-4641-962e-34494fc2ca0c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.752526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ea952-4e9e-4b4c-a199-7419d183713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.753244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea952-4e9e-4b4c-a199-7419d183713a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.753527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea952-4e9e-4b4c-a199-7419d183713a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.755846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ea952-4e9e-4b4c-a199-7419d183713a admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.755846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea952-4e9e-4b4c-a199-7419d183713a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.756149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ea952-4e9e-4b4c-a199-7419d183713a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.766533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 932/1871] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:40.771256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:40.781682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a53679-5158-4db6-b10a-98a4e1d38cd6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:40.786310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:40.786964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.787247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.787524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] PATH_INFO: `/v3/projects/8bce32d6e53c4df1b172617cec781a5c/users/d52def463e8f48c6af558ba476e71d20/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.803115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bce32d6e53c4df1b172617cec781a5c, user_id=d52def463e8f48c6af558ba476e71d20, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:40.805652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:40.921523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 940/1872] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:40 2022] PUT /identity/v3/projects/8bce32d6e53c4df1b172617cec781a5c/users/d52def463e8f48c6af558ba476e71d20/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:40.932128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:40.936983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:40.937534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:40.980210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] MFA Rules not processed for user `d52def463e8f48c6af558ba476e71d20`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:40.981449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:41.065329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 933/1873] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:41.069844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.121653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:41.144857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31700d0e-cbb3-42fb-8fcd-4e19674de8d5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.150195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.151494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.151819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.151953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.152581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.154627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.311836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 941/1874] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:41 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:41.318902 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.350681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e046573a-ce1c-4155-99c2-c7c3cb290586 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.455523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.458968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.458968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.458968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.458968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.459773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.583222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 934/1875] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:41 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:41.586904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.606486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ba6ec-5e0e-462e-b38a-67be2a5cbced admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.614260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.614894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.616760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.616760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.616760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.617944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.629581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 942/1876] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:41.633825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.646290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a79445-86c0-4c78-b57e-81942ed78393 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.651532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.652218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.652509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.652789 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] PATH_INFO: `/v3/projects/f75f369f34924dd8bce1326441e5c339/users/299e16d759a64441b51f2e0f2b24a6e0/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.675770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75f369f34924dd8bce1326441e5c339, user_id=299e16d759a64441b51f2e0f2b24a6e0, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.678778 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.788591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 935/1877] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:41 2022] PUT /identity/v3/projects/f75f369f34924dd8bce1326441e5c339/users/299e16d759a64441b51f2e0f2b24a6e0/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:41.793937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.823036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c614fe-48fa-4944-be96-5fb8be341112 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.907786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c638b6-7dc7-4ff0-be22-38ce02abfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.908719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c638b6-7dc7-4ff0-be22-38ce02abfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.909162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c638b6-7dc7-4ff0-be22-38ce02abfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.909585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c638b6-7dc7-4ff0-be22-38ce02abfa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.910660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c638b6-7dc7-4ff0-be22-38ce02abfa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.912556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c638b6-7dc7-4ff0-be22-38ce02abfa36 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.925045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 943/1878] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:41.928964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:41.941841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985bcf2-3aa3-4d65-859f-0d8d145f77c9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:41.947134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:41.948339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:41.948781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:41.949213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] PATH_INFO: `/v3/projects/f75f369f34924dd8bce1326441e5c339/users/299e16d759a64441b51f2e0f2b24a6e0/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:41.951534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f75f369f34924dd8bce1326441e5c339, user_id=299e16d759a64441b51f2e0f2b24a6e0, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:41.954487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:41.985377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 936/1879] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:41 2022] PUT /identity/v3/projects/f75f369f34924dd8bce1326441e5c339/users/299e16d759a64441b51f2e0f2b24a6e0/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:41.996871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.010307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.010748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.053308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] MFA Rules not processed for user `299e16d759a64441b51f2e0f2b24a6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:42.054796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.136182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 944/1880] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:42.238373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:42.240663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:42.325969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d0ac-da83-4bf6-8fb6-2d09feb8b13a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:42.329551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36af7b-7c7d-49fe-b4be-0372b01234c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:42.330218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36af7b-7c7d-49fe-b4be-0372b01234c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:42.338067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36af7b-7c7d-49fe-b4be-0372b01234c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:42.343164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36af7b-7c7d-49fe-b4be-0372b01234c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:42.402393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36af7b-7c7d-49fe-b4be-0372b01234c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:42.403847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36af7b-7c7d-49fe-b4be-0372b01234c1 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:42.413235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 937/1881] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:42.921695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:43.231012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.232648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.300769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdf3c-dd30-4efc-8651-a4b36e0d9094 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.311862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.311862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.311862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.311862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] PATH_INFO: `/v3/users/158de5c47e6c41f08d7921513e01e4a5` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.312223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158de5c47e6c41f08d7921513e01e4a5)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.312223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.563678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158de5c47e6c41f08d7921513e01e4a5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.564344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158de5c47e6c41f08d7921513e01e4a5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.564960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158de5c47e6c41f08d7921513e01e4a5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.577721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158de5c47e6c41f08d7921513e01e4a5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.664669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158de5c47e6c41f08d7921513e01e4a5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:43.679151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 945/1882] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:43 2022] DELETE /identity/v3/users/158de5c47e6c41f08d7921513e01e4a5 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:43.684458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.684815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.685175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.704488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:43.705699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.764173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 938/1883] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:43.774355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:43.775785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:43.837122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b47c2-d54b-433b-8995-06784c383439 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:43.840790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:43.841397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:43.841677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:43.842095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:43.851638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:43.853190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:43.864255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 946/1884] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:44.379710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:44.392088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:44.394472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:44.420434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0ca61-7b73-4f33-aac0-564befdbc595 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:44.426177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:44.427717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:44.428240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:44.428669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] PATH_INFO: `/v3/projects/057093ff78bd42ea813ac6746f6d9eb4` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:44.430784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=057093ff78bd42ea813ac6746f6d9eb4)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:44.434006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:44.659201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '057093ff78bd42ea813ac6746f6d9eb4', 'request_id': 'req-460a6596-2a88-4d77-98db-ca35819eab67'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.667243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '057093ff78bd42ea813ac6746f6d9eb4', 'request_id': 'req-460a6596-2a88-4d77-98db-ca35819eab67'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.681273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '057093ff78bd42ea813ac6746f6d9eb4', 'request_id': 'req-460a6596-2a88-4d77-98db-ca35819eab67'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.766655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] The token cache is being invalidate because project 057093ff78bd42ea813ac6746f6d9eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:44.766956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.767619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:44.769216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 939/1885] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:44 2022] DELETE /identity/v3/projects/057093ff78bd42ea813ac6746f6d9eb4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:44.773310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:44.794862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab25926-8c6e-480b-9a34-aff6e7c05390 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:44.865087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:44.865743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:44.866055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:44.866363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] PATH_INFO: `/v3/users/fdddee0a7b1a483cb3dd610038f58c66` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:44.867632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdddee0a7b1a483cb3dd610038f58c66)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:44.869565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.255578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdddee0a7b1a483cb3dd610038f58c66'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.257423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdddee0a7b1a483cb3dd610038f58c66'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.259435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdddee0a7b1a483cb3dd610038f58c66'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.294228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdddee0a7b1a483cb3dd610038f58c66'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.481440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdddee0a7b1a483cb3dd610038f58c66'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:45.495599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 947/1886] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:44 2022] DELETE /identity/v3/users/fdddee0a7b1a483cb3dd610038f58c66 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:45.763720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:45.769964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:45.837540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6596-2a88-4d77-98db-ca35819eab67 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:45.906529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:45.907286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:45.907644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:45.908313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:45.915620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:45.962793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:45.979567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:45.981008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:45.990479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 940/1887] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:46.216248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.217727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:46.289518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba402531-e73a-49ff-a2cd-c663c6fa98c1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.295329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.295966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.296245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.296515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] PATH_INFO: `/v3/projects/ee0416cde1a4481b88a88f1010ecce97` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.298901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0416cde1a4481b88a88f1010ecce97)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.301059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:46.520935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0416cde1a4481b88a88f1010ecce97', 'request_id': 'req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.547551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0416cde1a4481b88a88f1010ecce97', 'request_id': 'req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.721518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0416cde1a4481b88a88f1010ecce97', 'request_id': 'req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.733932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] The token cache is being invalidate because project ee0416cde1a4481b88a88f1010ecce97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:46.734236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.734914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:46.736431 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 948/1888] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:46 2022] DELETE /identity/v3/projects/ee0416cde1a4481b88a88f1010ecce97 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:46.740580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:46.751576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee321c30-0a0f-4d01-954b-518186baf5e9 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:46.811178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:46.811741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:46.812010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:46.812271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] PATH_INFO: `/v3/users/88913f7c7516409c84485b4adbd69ec6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:46.813488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88913f7c7516409c84485b4adbd69ec6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:46.815490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:47.098853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88913f7c7516409c84485b4adbd69ec6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:47.099795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88913f7c7516409c84485b4adbd69ec6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:47.100821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88913f7c7516409c84485b4adbd69ec6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:47.118731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88913f7c7516409c84485b4adbd69ec6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:47.368258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88913f7c7516409c84485b4adbd69ec6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:47.384434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 941/1889] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:46 2022] DELETE /identity/v3/users/88913f7c7516409c84485b4adbd69ec6 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:47.965336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:47.968241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:47.981571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d70b-cf4f-46d0-b5ed-705ce0f8f3ac admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.063201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.064166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.064573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.064961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] PATH_INFO: `/v3/projects/70ddb2b61dc34dd198f2e3c96790b0cd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.066691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ddb2b61dc34dd198f2e3c96790b0cd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.070160 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.181790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.183348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.243175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72320-515c-439d-b06b-7ca43cc2ef81 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.247856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.248214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.248497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.248775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.250583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.290022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ddb2b61dc34dd198f2e3c96790b0cd', 'request_id': 'req-971c6a92-2f4f-4979-8210-80923afb1b01'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:48.297497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ddb2b61dc34dd198f2e3c96790b0cd', 'request_id': 'req-971c6a92-2f4f-4979-8210-80923afb1b01'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:48.318820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.320252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed29774-0267-44f1-9771-130c5e3aa474 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.330374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 942/1890] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:48:48.470639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ddb2b61dc34dd198f2e3c96790b0cd', 'request_id': 'req-971c6a92-2f4f-4979-8210-80923afb1b01'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:48.482709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] The token cache is being invalidate because project 70ddb2b61dc34dd198f2e3c96790b0cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:48.483003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:48.483673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-971c6a92-2f4f-4979-8210-80923afb1b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:48.485171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 949/1891] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:47 2022] DELETE /identity/v3/projects/70ddb2b61dc34dd198f2e3c96790b0cd => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:48.491278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.491640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.491987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.513123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:48.514479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.591320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 943/1892] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:48.593188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.593491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.593855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.613869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:48.615033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:48.623529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 950/1893] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:48.627793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.638682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed054360-de35-4b42-8c27-15b0c50ba1fb None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.645364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.645364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.645364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.645364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.645713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:48.645713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.647440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.663330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 944/1894] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:48.668371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.673572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:48.679033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513c5c8-879c-4b72-ba58-a3bd5bd8e4d5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.684728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.685617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.685823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.686075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.686714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.688870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:48.862644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 951/1895] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/projects => generated 391 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:48.866136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:48.885452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d3932-5681-48c1-b9fd-f9dffbc338f2 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:48.949559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:48.950534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:48.952677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:48.952677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:48.952677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:48.954311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.033239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 945/1896] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:48 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:49.038179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.048979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cbdb3-1c68-4fff-9c49-0c7517e36cb5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.053823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.054653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.054933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.055390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.056129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.057717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.069051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 952/1897] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:49.074311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.084801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a1890-c693-4126-9712-778483ea61a5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.090759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51b020-456d-4cb9-b133-4b6c16d1054c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.091374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51b020-456d-4cb9-b133-4b6c16d1054c admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.091654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51b020-456d-4cb9-b133-4b6c16d1054c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.092000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51b020-456d-4cb9-b133-4b6c16d1054c admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.092647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51b020-456d-4cb9-b133-4b6c16d1054c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.094316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51b020-456d-4cb9-b133-4b6c16d1054c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.105473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 946/1898] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:49.109948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.120174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e216bcd-4cd0-4c3a-b7df-80cc20662863 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.125131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.125917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.126207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.126484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] PATH_INFO: `/v3/projects/689ee3f04ae8499690e4c6fea5eed6ff/users/c81adfc4422545e191a1deef9b567447/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.142042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689ee3f04ae8499690e4c6fea5eed6ff, user_id=c81adfc4422545e191a1deef9b567447, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.144710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.219790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 953/1899] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:49 2022] PUT /identity/v3/projects/689ee3f04ae8499690e4c6fea5eed6ff/users/c81adfc4422545e191a1deef9b567447/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:49.234645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.244616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.244616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.263926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] MFA Rules not processed for user `c81adfc4422545e191a1deef9b567447`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:49.265253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:49.334059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 947/1900] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:49.338502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.405587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63342-7dc3-4675-854f-097696f4d9d3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.410665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.411799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.411799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.412020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.412498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.414528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.555968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 954/1901] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:49 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:49.557437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.568915 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d755691-1247-4b23-8111-a60ea4f27015 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.629053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.629598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.629909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.630183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.630825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.632780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.784107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:49.784202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 948/1902] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:49 2022] POST /identity/v3/users => generated 301 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:49.785730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.796555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f5698-9f41-45ad-8252-1de4f513b6e1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.801178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.801792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.802088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.802364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.803004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.804590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.815970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 955/1903] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:49.820178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.830383 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f750a8-9d06-41c1-90e2-b6f09b1325cb admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:49.835388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:49.836047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:49.836330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:49.836603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] PATH_INFO: `/v3/projects/a8068d3754cf4f8bbd0fff24a1121d75/users/f98eb0e62acd41158a09e2fcf05e4873/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:49.852668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8068d3754cf4f8bbd0fff24a1121d75, user_id=f98eb0e62acd41158a09e2fcf05e4873, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:49.855996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:49.935040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 949/1904] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:49 2022] PUT /identity/v3/projects/a8068d3754cf4f8bbd0fff24a1121d75/users/f98eb0e62acd41158a09e2fcf05e4873/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:49.940112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:49.951209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34d5f1-624c-426f-981c-e72716baf399 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:50.008907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2347cd-1900-4f49-9fc3-7e708ba122e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:50.009520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2347cd-1900-4f49-9fc3-7e708ba122e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.009830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2347cd-1900-4f49-9fc3-7e708ba122e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.010109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2347cd-1900-4f49-9fc3-7e708ba122e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.010755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2347cd-1900-4f49-9fc3-7e708ba122e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:50.012423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2347cd-1900-4f49-9fc3-7e708ba122e8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:50.023819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 956/1905] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:50.027871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:50.046225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbbe4d-e456-49f4-a6fb-2849758cb423 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:50.051203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:50.052015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.052406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.052784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] PATH_INFO: `/v3/projects/a8068d3754cf4f8bbd0fff24a1121d75/users/f98eb0e62acd41158a09e2fcf05e4873/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.055031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8068d3754cf4f8bbd0fff24a1121d75, user_id=f98eb0e62acd41158a09e2fcf05e4873, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:50.061351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:50.074178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 950/1906] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:50 2022] PUT /identity/v3/projects/a8068d3754cf4f8bbd0fff24a1121d75/users/f98eb0e62acd41158a09e2fcf05e4873/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:50.088403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.088855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.088984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.121351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] MFA Rules not processed for user `f98eb0e62acd41158a09e2fcf05e4873`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:50.123799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:50.208769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 957/1907] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:50.250046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:50.252036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:50.365943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4602ed-bbe1-4b06-a774-a8f3bda55bb8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:50.372587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:50.373622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.374179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.374666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.397584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:50.397812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:50.427119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 951/1908] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:50.545972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:50.547912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:50.562775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571670-aef7-4dae-8001-eab00e9237d6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:50.567964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:50.568846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:50.569346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:50.572326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:50.655491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:50.657121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:50.672586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 958/1909] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:50.780514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:51.442889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:51.444489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:51.451996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:51.454112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:51.563669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b030276-3c5c-478a-be72-553397002ac5 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:51.570835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:51.571214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff346d-1144-4ce6-90d9-10b266c854a4 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:51.572365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:51.572740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:51.573118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] PATH_INFO: `/v3/users/ab73769ad9db4458a0aaa1b685f3b39a` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:51.575858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab73769ad9db4458a0aaa1b685f3b39a)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:51.577821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:51.578326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:51.582568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:51.582568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:51.582568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] PATH_INFO: `/v3/users/34a5b35f1fed4f57a084fc2bf75916d1` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:51.582568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a5b35f1fed4f57a084fc2bf75916d1)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:51.582568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:51.861912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a5b35f1fed4f57a084fc2bf75916d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.864667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a5b35f1fed4f57a084fc2bf75916d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.865389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a5b35f1fed4f57a084fc2bf75916d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.872240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab73769ad9db4458a0aaa1b685f3b39a'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.873633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab73769ad9db4458a0aaa1b685f3b39a'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.874410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab73769ad9db4458a0aaa1b685f3b39a'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.887205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a5b35f1fed4f57a084fc2bf75916d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:51.894630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab73769ad9db4458a0aaa1b685f3b39a'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.008754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b29850bb-b7ba-4ff5-9a23-b015e5d0cc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a5b35f1fed4f57a084fc2bf75916d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.026092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 952/1910] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:51 2022] DELETE /identity/v3/users/34a5b35f1fed4f57a084fc2bf75916d1 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:52.030533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.030818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.031111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.053525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:52.055209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:52.078397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-538f9493-16dd-462e-8e80-9ae4a6791199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab73769ad9db4458a0aaa1b685f3b39a'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:52.114642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 959/1911] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:51 2022] DELETE /identity/v3/users/ab73769ad9db4458a0aaa1b685f3b39a => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:52.114642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.114642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.114642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.133731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:52.135140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:52.160026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 953/1912] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:52.178649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:52.181851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:52.204641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 960/1913] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:52.216142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:52.217983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:52.272160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92313d-d253-4c62-9ce0-0953a90ecbe0 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:52.318192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ad25e-d521-496f-bea8-0b0e7617737c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:52.324956 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:52.325649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.326110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.330015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.338201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:52.340697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:52.357487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:52.358222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.358571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.358912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.365996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 961/1914] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:52.369905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:52.372018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:52.383003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 954/1915] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:52.638384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.774712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:52.899662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:52.901177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:52.939810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cfbd83-e98a-4836-a20e-efe3ce67408e service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:52.945949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:52.946654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:52.946938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:52.947210 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] PATH_INFO: `/v3/projects/e44740712d384718bcd77943fc959757` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:52.948396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44740712d384718bcd77943fc959757)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:52.950461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:53.119946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44740712d384718bcd77943fc959757', 'request_id': 'req-67e3db2e-370e-49da-a4d2-c1868b82d585'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.160034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44740712d384718bcd77943fc959757', 'request_id': 'req-67e3db2e-370e-49da-a4d2-c1868b82d585'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.232073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44740712d384718bcd77943fc959757', 'request_id': 'req-67e3db2e-370e-49da-a4d2-c1868b82d585'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.249643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] The token cache is being invalidate because project e44740712d384718bcd77943fc959757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:53.250190 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.251167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.255862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 962/1916] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:52 2022] DELETE /identity/v3/projects/e44740712d384718bcd77943fc959757 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:53.259939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:53.270409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72333bee-0a19-4058-a456-057edd7607e6 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:53.337453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:53.338237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:53.338524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:53.338801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] PATH_INFO: `/v3/users/c6f9799b6249495cabbdf6394bc545e6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:53.340454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6f9799b6249495cabbdf6394bc545e6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:53.342498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:53.457372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:53.458850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:53.478568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3db2e-370e-49da-a4d2-c1868b82d585 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:53.483957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:53.484688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:53.484857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:53.485213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] PATH_INFO: `/v3/projects/59cc82d22ca748ea8869f961ddac6821` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:53.486317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cc82d22ca748ea8869f961ddac6821)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:53.488525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:53.621539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6f9799b6249495cabbdf6394bc545e6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.622354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6f9799b6249495cabbdf6394bc545e6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.623174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6f9799b6249495cabbdf6394bc545e6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.638248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6f9799b6249495cabbdf6394bc545e6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.640203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cc82d22ca748ea8869f961ddac6821', 'request_id': 'req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.649582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cc82d22ca748ea8869f961ddac6821', 'request_id': 'req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.906434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cc82d22ca748ea8869f961ddac6821', 'request_id': 'req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.921355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] The token cache is being invalidate because project 59cc82d22ca748ea8869f961ddac6821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:53.921355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.921355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:53.925923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 963/1917] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:53 2022] DELETE /identity/v3/projects/59cc82d22ca748ea8869f961ddac6821 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:53.926921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:53.928516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:54.003910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b43c0c-2343-43ac-bbda-e0386f6a1e03 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.009028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.009682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.009997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.010275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] PATH_INFO: `/v3/users/8def7f5b7e284b5bae5e6c7f72466d5b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.012058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8def7f5b7e284b5bae5e6c7f72466d5b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.014024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.048013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6f9799b6249495cabbdf6394bc545e6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.061532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 955/1918] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:53 2022] DELETE /identity/v3/users/c6f9799b6249495cabbdf6394bc545e6 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:54.267486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8def7f5b7e284b5bae5e6c7f72466d5b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.268404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8def7f5b7e284b5bae5e6c7f72466d5b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.269529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8def7f5b7e284b5bae5e6c7f72466d5b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.300651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8def7f5b7e284b5bae5e6c7f72466d5b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.357835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8def7f5b7e284b5bae5e6c7f72466d5b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:54.373416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 964/1919] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:53 2022] DELETE /identity/v3/users/8def7f5b7e284b5bae5e6c7f72466d5b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:54.472343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:54.680120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.682504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:54.696433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:54.699873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:54.856612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a5202-97d3-4ff6-94b1-45d38da2e90f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.866785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.867290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335f2a7-a6f1-4809-aaae-09cdd1bfe95c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:54.867466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.867554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.867835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] PATH_INFO: `/v3/projects/79e2177dbe0f4801b02e076bdeac036f` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.870749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e2177dbe0f4801b02e076bdeac036f)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.873140 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:54.873581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:54.874384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:54.874901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:54.875253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] PATH_INFO: `/v3/users/a923608970be4d8a84789461ce3953f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:54.877671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a923608970be4d8a84789461ce3953f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:54.886503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.100267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a923608970be4d8a84789461ce3953f3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.101218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a923608970be4d8a84789461ce3953f3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.101805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e2177dbe0f4801b02e076bdeac036f', 'request_id': 'req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.102290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a923608970be4d8a84789461ce3953f3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.127529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e2177dbe0f4801b02e076bdeac036f', 'request_id': 'req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.127664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a923608970be4d8a84789461ce3953f3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.127755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e2177dbe0f4801b02e076bdeac036f', 'request_id': 'req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.180373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:55.253191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe567f44-a600-455e-b58f-ed0d33c08aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a923608970be4d8a84789461ce3953f3'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.335398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] The token cache is being invalidate because project 79e2177dbe0f4801b02e076bdeac036f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:55.335681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.336736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.339455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 956/1920] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:54 2022] DELETE /identity/v3/projects/79e2177dbe0f4801b02e076bdeac036f => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:55.341169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.344063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.354340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 965/1921] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:54 2022] DELETE /identity/v3/users/a923608970be4d8a84789461ce3953f3 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:55.357790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2f44-db9a-4066-8afa-4da9394e8e1b None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.358074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2f44-db9a-4066-8afa-4da9394e8e1b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.358350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2f44-db9a-4066-8afa-4da9394e8e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.431122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-19ad2f44-db9a-4066-8afa-4da9394e8e1b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.432409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-19ad2f44-db9a-4066-8afa-4da9394e8e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.461784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1d23f-4469-4c4a-be11-3fc06fda60f9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.465912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:55.556227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 966/1922] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:55.562195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc5e1-1165-4e1c-b3b5-b9264e09770a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.562195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc5e1-1165-4e1c-b3b5-b9264e09770a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.562195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdc5e1-1165-4e1c-b3b5-b9264e09770a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.563935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.565537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.565813 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.566377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] PATH_INFO: `/v3/projects/340161801dca407a83b56179ad9270c3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.567697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=340161801dca407a83b56179ad9270c3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.569811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.581638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-13bdc5e1-1165-4e1c-b3b5-b9264e09770a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.583227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-13bdc5e1-1165-4e1c-b3b5-b9264e09770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.594202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 967/1923] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:55.596513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.596971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.597248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.626699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.628240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.640985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 968/1924] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:55.642213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.643727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.714457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '340161801dca407a83b56179ad9270c3', 'request_id': 'req-c769cc48-1cf1-4236-804b-988ec02b7a4a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.724125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '340161801dca407a83b56179ad9270c3', 'request_id': 'req-c769cc48-1cf1-4236-804b-988ec02b7a4a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.737804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '340161801dca407a83b56179ad9270c3', 'request_id': 'req-c769cc48-1cf1-4236-804b-988ec02b7a4a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.745458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f9bf-e36d-4b20-a1f0-f936cd3bad14 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.803934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd57004-e232-4eb1-8e74-dbc737676514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.804760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57004-e232-4eb1-8e74-dbc737676514 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.805066 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57004-e232-4eb1-8e74-dbc737676514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.805353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd57004-e232-4eb1-8e74-dbc737676514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.843273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] The token cache is being invalidate because project 340161801dca407a83b56179ad9270c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:55.843565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.846119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:55.849593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 957/1925] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:55 2022] DELETE /identity/v3/projects/340161801dca407a83b56179ad9270c3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:55.850701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:55.852165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.882260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57004-e232-4eb1-8e74-dbc737676514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.883837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd57004-e232-4eb1-8e74-dbc737676514 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.905507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 969/1926] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:55.907043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b5fab-6f7e-48b7-8e94-3243fb1e3158 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.909857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b5fab-6f7e-48b7-8e94-3243fb1e3158 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.909857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b5fab-6f7e-48b7-8e94-3243fb1e3158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.931222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-da1b5fab-6f7e-48b7-8e94-3243fb1e3158 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.932717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-da1b5fab-6f7e-48b7-8e94-3243fb1e3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:55.947161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 970/1927] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:55.955619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.956093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.956506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.956791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769cc48-1cf1-4236-804b-988ec02b7a4a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:55.980017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:55.980685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:55.980968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:55.981239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:55.981933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:55.982236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:55.984059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:55.998049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:55.998049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.033303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 958/1928] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:56.033303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.033472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 971/1929] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:48:56.033472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.037536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5a305-4ac6-4184-88ad-c56f362dbbcc None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.051363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.052509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.052811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.053079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.054562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:48:56.055305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.057067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.061500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd69beb-4a52-4690-b3cf-6ac3c32d94e6 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.073167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.073822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.074644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.075350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.076054 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.078446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 972/1930] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:48:56.082603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.082873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.098117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355a1d8-55e0-47e4-b337-4c562082bb18 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.104731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.106008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.106617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.107170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.107998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.110383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.207761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 959/1931] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:56.212211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.224292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 973/1932] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:56.225860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.297605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54114c-8a69-4d59-aa3a-7c8c74288fec admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.355410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a34f4-daab-4947-ae5a-80d38f3723a0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.360594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.361220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.361506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.361805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.362532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.364403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.372075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.372869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.373295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.373722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.374800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.376821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.485751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 974/1933] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:56.490404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.515305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a6043-589b-423b-8cb0-d711c515d04a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.521374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.521816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.522092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.522369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.523352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.525267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.535765 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 960/1934] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/users => generated 290 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:48:56.539572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.546276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 975/1935] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:56.547939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.557234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b94318-0a46-4260-8378-4e10ff17617c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.564344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dd6dd-18ab-4d69-b9db-1abbad008de6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.570378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.570986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.571322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.572518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.573586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.574996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.575309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.575415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.575595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.575876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.576538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.578182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.590869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 961/1936] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:48:56.596187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.604337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 976/1937] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:56.613332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac46b-a554-4d35-9f1e-e0ac4122e72f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.618199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.618537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.619231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.619588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.619938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.620694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.623278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.635712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bcae8-2a7e-4886-ad73-98e00ad63704 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.639587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 962/1938] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:56.643362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.645532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.651192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.651490 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.651770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] PATH_INFO: `/v3/projects/19e7d938a3f94befad02f4b05cd2ab54/users/7c642adf934f45fb88e6f92a9dab3cca/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.657538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2034f-5e29-4538-b053-961eacb5c8df admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.664432 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973454e1-1693-479a-88b2-e0773ab7cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.665660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973454e1-1693-479a-88b2-e0773ab7cad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.665983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973454e1-1693-479a-88b2-e0773ab7cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.668479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973454e1-1693-479a-88b2-e0773ab7cad2 admin admin] PATH_INFO: `/v3/projects/a28780c8daef4bacb9e46ca3a6645616/users/48fa59dc05f0494a85635254682d0687/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.672941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e7d938a3f94befad02f4b05cd2ab54, user_id=7c642adf934f45fb88e6f92a9dab3cca, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.676447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.686501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973454e1-1693-479a-88b2-e0773ab7cad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a28780c8daef4bacb9e46ca3a6645616, user_id=48fa59dc05f0494a85635254682d0687, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.689980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973454e1-1693-479a-88b2-e0773ab7cad2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.768807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 977/1939] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:56 2022] PUT /identity/v3/projects/19e7d938a3f94befad02f4b05cd2ab54/users/7c642adf934f45fb88e6f92a9dab3cca/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:56.768807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:56.774033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.803453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 963/1940] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:56 2022] PUT /identity/v3/projects/a28780c8daef4bacb9e46ca3a6645616/users/48fa59dc05f0494a85635254682d0687/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:48:56.806004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7080c-a805-409a-98d2-288252fd7cc6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.806501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7080c-a805-409a-98d2-288252fd7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.807109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7080c-a805-409a-98d2-288252fd7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.843457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4ee7080c-a805-409a-98d2-288252fd7cc6 None None] MFA Rules not processed for user `7c642adf934f45fb88e6f92a9dab3cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:56.844964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4ee7080c-a805-409a-98d2-288252fd7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:56.872752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9913e75-87f1-4f95-933b-bf6cf21ae2b1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:56.938707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 964/1941] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:56.943497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.944622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.944622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.951075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:56.951742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:56.952028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:56.952307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] PATH_INFO: `/v3/projects/7d9fae069df14a1ea0d76f9c227f0acb` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:56.954537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9fae069df14a1ea0d76f9c227f0acb)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:56.956824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:56.984344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] MFA Rules not processed for user `48fa59dc05f0494a85635254682d0687`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:56.985812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.059187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 965/1942] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:57.060503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.072113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084e10-8977-4049-aaf1-c64346e11481 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.076852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.077474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.077785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.078332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.078974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.080901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.174349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9fae069df14a1ea0d76f9c227f0acb', 'request_id': 'req-339d1271-3aef-4287-827c-94fa91e7f57e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.184303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9fae069df14a1ea0d76f9c227f0acb', 'request_id': 'req-339d1271-3aef-4287-827c-94fa91e7f57e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.186950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 966/1943] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:57.187815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.295999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9469275-0567-4261-a7e2-bfa5499a9149 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.303280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.307897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.307897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.307897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.307897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.308624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.346381 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9fae069df14a1ea0d76f9c227f0acb', 'request_id': 'req-339d1271-3aef-4287-827c-94fa91e7f57e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.357883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] The token cache is being invalidate because project 7d9fae069df14a1ea0d76f9c227f0acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:57.358183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.359006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.365755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 978/1944] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:56 2022] DELETE /identity/v3/projects/7d9fae069df14a1ea0d76f9c227f0acb => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:57.365755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.366274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.444041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d1271-3aef-4287-827c-94fa91e7f57e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.451888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.452908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.453357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.453632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.454327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.456425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.477720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 967/1945] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:57.478425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.480265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.555424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 979/1946] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:57.556460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.558375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.566819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02d342-35cb-48cd-85ec-39c64f66d941 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.573039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.575687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.575687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.575687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] PATH_INFO: `/v3/users/d52def463e8f48c6af558ba476e71d20` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.576387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371c70a-94cc-4023-aba9-aa1d18f80b2f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.576852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52def463e8f48c6af558ba476e71d20)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.579048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.582577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.582794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.583026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.583302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.583930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.585901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.708282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 980/1947] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:48:57 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:48:57.709333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.719583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a3d8-fa09-4b82-80e8-ee01d0db7d9d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.724514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.725153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.725418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.725690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.726363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.728163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.738120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 981/1948] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:57.742852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.748726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f4079-9346-4f55-b6c8-32944eb34ed3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.753403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.754002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.754282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.754553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.755225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.756775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.771348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 982/1949] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:57.771348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.780526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af37f3-dcf0-4a5f-8e32-add8d7bcc340 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:57.785486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:57.786204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:57.786483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:57.786759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] PATH_INFO: `/v3/projects/5ca67771332444ae99ef0ddf5a076633/users/ef024eddacfd429eb22d61bfbe590cfb/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:57.806072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:57.811784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca67771332444ae99ef0ddf5a076633, user_id=ef024eddacfd429eb22d61bfbe590cfb, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:57.814076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:57.814423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52def463e8f48c6af558ba476e71d20'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.815386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52def463e8f48c6af558ba476e71d20'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.816489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52def463e8f48c6af558ba476e71d20'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.830038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52def463e8f48c6af558ba476e71d20'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.922974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52def463e8f48c6af558ba476e71d20'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:57.934543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 983/1950] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:57 2022] PUT /identity/v3/projects/5ca67771332444ae99ef0ddf5a076633/users/ef024eddacfd429eb22d61bfbe590cfb/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:57.936797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.937129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:57.940517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 968/1951] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:57 2022] DELETE /identity/v3/users/d52def463e8f48c6af558ba476e71d20 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:57.943819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:57.944913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.018981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9150b76-018c-4a3e-be05-070b87ee66ff admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.022946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:58.028672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.028672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.028672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.028672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] PATH_INFO: `/v3/projects/b84f9dd00b7442e78a0beb4286bd6e5d/users/4d6982b92b914d3ca2fc1448de7a2494/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.029040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fe5e3-6688-463b-81df-382d8fa4dafc admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.032269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.032941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.033236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.033514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.034209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.035823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.042722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84f9dd00b7442e78a0beb4286bd6e5d, user_id=4d6982b92b914d3ca2fc1448de7a2494, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.045962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.047051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 969/1952] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:58.047890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.049567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.063074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e47021-2b13-4e21-b1b3-c2f0010e80c0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.068107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.068661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.068945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.069221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] PATH_INFO: `/v3/users/c81adfc4422545e191a1deef9b567447` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.070418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81adfc4422545e191a1deef9b567447)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.072337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.149530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 984/1953] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:57 2022] PUT /identity/v3/projects/b84f9dd00b7442e78a0beb4286bd6e5d/users/4d6982b92b914d3ca2fc1448de7a2494/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:58.149530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.216197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9da54-6e80-4a46-ae92-55c796754a69 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.221016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.221690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.222015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.222292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] PATH_INFO: `/v3/projects/5ca67771332444ae99ef0ddf5a076633/users/ef024eddacfd429eb22d61bfbe590cfb/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.224336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca67771332444ae99ef0ddf5a076633, user_id=ef024eddacfd429eb22d61bfbe590cfb, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.227021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.249199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 985/1954] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:58 2022] PUT /identity/v3/projects/5ca67771332444ae99ef0ddf5a076633/users/ef024eddacfd429eb22d61bfbe590cfb/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:58.249199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.286909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81adfc4422545e191a1deef9b567447'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.287816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81adfc4422545e191a1deef9b567447'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.288558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81adfc4422545e191a1deef9b567447'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.310112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f379c-6eed-4e54-9db2-8c5b58604cc3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.316189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64995cc9-5417-4be5-a6e6-39aca83620b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.319589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995cc9-5417-4be5-a6e6-39aca83620b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.319715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81adfc4422545e191a1deef9b567447'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.320131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995cc9-5417-4be5-a6e6-39aca83620b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.320131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64995cc9-5417-4be5-a6e6-39aca83620b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.320131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64995cc9-5417-4be5-a6e6-39aca83620b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.320131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64995cc9-5417-4be5-a6e6-39aca83620b2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.330842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 986/1955] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:48:58.332183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.332514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.332841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.361730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] MFA Rules not processed for user `ef024eddacfd429eb22d61bfbe590cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:58.362946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.416119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81adfc4422545e191a1deef9b567447'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.439635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 970/1956] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:58 2022] DELETE /identity/v3/users/c81adfc4422545e191a1deef9b567447 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:58.440780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.442244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.443948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 987/1957] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:58.444963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.446771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.484769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af945bc8-0b3d-4bd2-a48b-5e32b59c5ec5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.526691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86f62f-2fc0-4cce-8fae-c7cd872ea9cc admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.534087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee49016-9130-41c2-a3d2-7dcbd5f257f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.534782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49016-9130-41c2-a3d2-7dcbd5f257f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.535073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49016-9130-41c2-a3d2-7dcbd5f257f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.535350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee49016-9130-41c2-a3d2-7dcbd5f257f9 admin admin] PATH_INFO: `/v3/projects/b84f9dd00b7442e78a0beb4286bd6e5d/users/4d6982b92b914d3ca2fc1448de7a2494/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.537460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49016-9130-41c2-a3d2-7dcbd5f257f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84f9dd00b7442e78a0beb4286bd6e5d, user_id=4d6982b92b914d3ca2fc1448de7a2494, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.540406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee49016-9130-41c2-a3d2-7dcbd5f257f9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.548561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.555263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.555263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.555263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] PATH_INFO: `/v3/projects/8bce32d6e53c4df1b172617cec781a5c` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.555263 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bce32d6e53c4df1b172617cec781a5c)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.555589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 971/1958] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:48:58 2022] PUT /identity/v3/projects/b84f9dd00b7442e78a0beb4286bd6e5d/users/4d6982b92b914d3ca2fc1448de7a2494/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:58.555670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.555740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.555740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.555740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.573982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:58.575249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.638255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 972/1959] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:58.648886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.648886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.695278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bce32d6e53c4df1b172617cec781a5c', 'request_id': 'req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.702607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bce32d6e53c4df1b172617cec781a5c', 'request_id': 'req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.714366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:58.719153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed82d3a-9bf8-43b4-b454-3baaab99edf1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.767561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.768285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.768574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.768856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.775195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bce32d6e53c4df1b172617cec781a5c', 'request_id': 'req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.786746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] The token cache is being invalidate because project 8bce32d6e53c4df1b172617cec781a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:58.787033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.787696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7c024fb-c8f4-44c9-8fcf-611a0848d0a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:58.789251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 988/1960] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:58 2022] DELETE /identity/v3/projects/8bce32d6e53c4df1b172617cec781a5c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:58.790488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.790819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.791095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.820830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] MFA Rules not processed for user `4d6982b92b914d3ca2fc1448de7a2494`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:48:58.827653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.831983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.833455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.844038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 973/1961] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:58.845332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.846785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.902005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 989/1962] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:48:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:48:58.902005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:58.902005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.907702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f524eb-5072-43fa-bf90-1dbe0e2e91e9 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.911529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.912176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.912469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.912736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.914557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:58.967529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bb1e2-1db1-4164-8834-84d83aa34ab5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:58.972453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:58.973159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:58.973444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:58.973725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] PATH_INFO: `/v3/users/299e16d759a64441b51f2e0f2b24a6e0` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:58.975082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299e16d759a64441b51f2e0f2b24a6e0)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.977283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:58.989804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:58.991248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.001018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 974/1963] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:59.002014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.003423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.015427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550212be-4298-45e3-9282-cbb41a2b4cf5 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.019482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.022570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.022570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.022570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.033235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.036060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.046668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 975/1964] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:48:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:48:59.182288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299e16d759a64441b51f2e0f2b24a6e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.182943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299e16d759a64441b51f2e0f2b24a6e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.183576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299e16d759a64441b51f2e0f2b24a6e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.196069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299e16d759a64441b51f2e0f2b24a6e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.277402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:48:59.279239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299e16d759a64441b51f2e0f2b24a6e0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.292934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 990/1965] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:58 2022] DELETE /identity/v3/users/299e16d759a64441b51f2e0f2b24a6e0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:59.468738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.469183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.483416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa247843-baef-49fd-91e6-318ab3f68e51 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.548230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.549081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.549441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.549836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] PATH_INFO: `/v3/projects/689ee3f04ae8499690e4c6fea5eed6ff` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.551738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] RBAC: Authorizing `identity:delete_project(project_id=689ee3f04ae8499690e4c6fea5eed6ff)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.554390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.701055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689ee3f04ae8499690e4c6fea5eed6ff', 'request_id': 'req-870c2746-210b-4a4e-92e4-c3df95a9520a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.708062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689ee3f04ae8499690e4c6fea5eed6ff', 'request_id': 'req-870c2746-210b-4a4e-92e4-c3df95a9520a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.715423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689ee3f04ae8499690e4c6fea5eed6ff', 'request_id': 'req-870c2746-210b-4a4e-92e4-c3df95a9520a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.776836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] The token cache is being invalidate because project 689ee3f04ae8499690e4c6fea5eed6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:48:59.777320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.778263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:48:59.783619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 976/1966] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:59 2022] DELETE /identity/v3/projects/689ee3f04ae8499690e4c6fea5eed6ff => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:48:59.784132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.785796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.804484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979d29f-ce2f-4bb3-9564-9820d19279d3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.870039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.870671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.870874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.871148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] PATH_INFO: `/v3/users/f98eb0e62acd41158a09e2fcf05e4873` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.872995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98eb0e62acd41158a09e2fcf05e4873)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.875031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:48:59.957594 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:48:59.959183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:48:59.977831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c2746-210b-4a4e-92e4-c3df95a9520a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:48:59.983716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:48:59.984364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:48:59.984642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:48:59.984917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] PATH_INFO: `/v3/projects/f75f369f34924dd8bce1326441e5c339` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:48:59.986084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f75f369f34924dd8bce1326441e5c339)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:48:59.987992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.067706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98eb0e62acd41158a09e2fcf05e4873'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.068423 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98eb0e62acd41158a09e2fcf05e4873'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.069729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98eb0e62acd41158a09e2fcf05e4873'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.082765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98eb0e62acd41158a09e2fcf05e4873'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.101291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f75f369f34924dd8bce1326441e5c339', 'request_id': 'req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.108205 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f75f369f34924dd8bce1326441e5c339', 'request_id': 'req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.114509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f75f369f34924dd8bce1326441e5c339', 'request_id': 'req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.151738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ba20c1be-2959-4d43-b6d7-c0d018fca798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98eb0e62acd41158a09e2fcf05e4873'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.166520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 991/1967] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:48:59 2022] DELETE /identity/v3/users/f98eb0e62acd41158a09e2fcf05e4873 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:00.225907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] The token cache is being invalidate because project f75f369f34924dd8bce1326441e5c339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:00.225907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.225907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.226767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 977/1968] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:48:59 2022] DELETE /identity/v3/projects/f75f369f34924dd8bce1326441e5c339 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:00.238550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18265-3215-4914-b302-29e09bb0fdff None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.238550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18265-3215-4914-b302-29e09bb0fdff None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.238550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a18265-3215-4914-b302-29e09bb0fdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.241095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.244142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.258137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a5a18265-3215-4914-b302-29e09bb0fdff None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:00.259739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a5a18265-3215-4914-b302-29e09bb0fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.327542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569ecbb-e26b-4b70-b0ad-5d0d162bf14f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.337973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 992/1969] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:00.341095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.341432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.341755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.363974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:00.365257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.374425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 993/1970] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:00.379316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.395196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36b84f-aefb-4577-b6e9-7f9e645a9630 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.395574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6982b92b914d3ca2fc1448de7a2494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.396307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.396673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.397017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.397863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:00.398178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.400195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.400586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.401320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.401611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.401941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.402700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:00.403014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.404656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.436631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 978/1971] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:00.436756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 994/1972] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:00.440756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.440883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.460888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a30ed4-4872-48a2-8f51-1fa1bd148463 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.466845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.470417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.470417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.470417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.470417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.472345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.478972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bc750-49d8-4c69-80ca-811dbef12015 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.493742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6982b92b914d3ca2fc1448de7a2494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.494818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.494818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.494818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.495438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.498405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.594838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 979/1973] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:00 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:00.598916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.637823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 995/1974] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:00 2022] POST /identity/v3/projects => generated 354 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:00.644034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:00.645866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:00.674294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2b695-d62a-4761-95ce-a91c3def6d81 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.718068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:00.722420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020b97-5bba-41ab-8776-d3b81a7a1790 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:00.728054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.728711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.728995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.729299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] PATH_INFO: `/v3/projects/a8068d3754cf4f8bbd0fff24a1121d75` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.731305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8068d3754cf4f8bbd0fff24a1121d75)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.733520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.737428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:00.738551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:00.738982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:00.739358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:00.740255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:00.742328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:00.911978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8068d3754cf4f8bbd0fff24a1121d75', 'request_id': 'req-1dad0055-dc15-49c1-9bc5-9ba7266eed70'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:00.918074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:00.927243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8068d3754cf4f8bbd0fff24a1121d75', 'request_id': 'req-1dad0055-dc15-49c1-9bc5-9ba7266eed70'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.085155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8068d3754cf4f8bbd0fff24a1121d75', 'request_id': 'req-1dad0055-dc15-49c1-9bc5-9ba7266eed70'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.094608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 980/1975] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:00 2022] POST /identity/v3/users => generated 286 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:01.094608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.111884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] The token cache is being invalidate because project a8068d3754cf4f8bbd0fff24a1121d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:01.112458 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.120081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.120081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 996/1976] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:00 2022] DELETE /identity/v3/projects/a8068d3754cf4f8bbd0fff24a1121d75 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:01.120081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.124105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.227965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08e2d-fbe3-4a15-b976-2b4c02ede32e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.235412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad0055-dc15-49c1-9bc5-9ba7266eed70 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.241372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c068a-26e0-4331-b7bf-ecbf8f063253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.242621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c068a-26e0-4331-b7bf-ecbf8f063253 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.243056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c068a-26e0-4331-b7bf-ecbf8f063253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.243515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c068a-26e0-4331-b7bf-ecbf8f063253 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.244335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c068a-26e0-4331-b7bf-ecbf8f063253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.246314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c068a-26e0-4331-b7bf-ecbf8f063253 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.264544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 997/1977] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:01.266315 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d83c0-0215-4ad4-93ba-48659ca54a0e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.271718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d83c0-0215-4ad4-93ba-48659ca54a0e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.279884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d83c0-0215-4ad4-93ba-48659ca54a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.307736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6982b92b914d3ca2fc1448de7a2494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.307736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.307736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.308038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d90d83c0-0215-4ad4-93ba-48659ca54a0e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:01.308139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.308227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d90d83c0-0215-4ad4-93ba-48659ca54a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.308319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:01.308319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.308319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.331636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 981/1978] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:01.331636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.331912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 998/1979] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:01.337329 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.338271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.343012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.366141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0ea62-9a2f-46a5-8354-4b6f67e35277 tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.371884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:01.373982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.375823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.376456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.376746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.377026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.377755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.381001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.395435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 999/1980] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:01.401211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.403777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.420569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 982/1981] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:01.423239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.428790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70a07c-ce78-4043-9ea0-b68c1b23c94b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.436442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d6982b92b914d3ca2fc1448de7a2494', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.437548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.437684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade901c0-331f-42d7-82e9-17d2159bb4e0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.437917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.438145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] PATH_INFO: `/v3/projects/9de231abcd4546c3ba12371ac0feb5d2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.439464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9de231abcd4546c3ba12371ac0feb5d2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.441469 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.443848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.444281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.444639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.445158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.445823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:01.446248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.450343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.470171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 983/1982] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:01.471159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.483767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f86db-ca4d-4192-93b4-f3ad2ab00f17 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.489058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.489749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.490067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.490344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] PATH_INFO: `/v3/projects/ba5ab194269e4bef9044ed070d0ec817/users/3589f2353d224fea87a654dd098b69a2/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.517652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5ab194269e4bef9044ed070d0ec817, user_id=3589f2353d224fea87a654dd098b69a2, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.522290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.617170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:01.617570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 984/1983] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:01 2022] PUT /identity/v3/projects/ba5ab194269e4bef9044ed070d0ec817/users/3589f2353d224fea87a654dd098b69a2/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:01.618791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.629822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de231abcd4546c3ba12371ac0feb5d2', 'request_id': 'req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.647689 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de231abcd4546c3ba12371ac0feb5d2', 'request_id': 'req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.733376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ee822-49f1-43c5-8f71-901a15ad4578 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.739476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.743358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.743358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.743358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.743358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.748394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.763878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de231abcd4546c3ba12371ac0feb5d2', 'request_id': 'req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.780507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] The token cache is being invalidate because project 9de231abcd4546c3ba12371ac0feb5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:01.780794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.781645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f8a7b62-c6cd-4683-860f-a25ca2d92b8b tempest-VolumeQuotaClassesTest-610382555 tempest-VolumeQuotaClassesTest-610382555-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:01.786710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1000/1984] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:01 2022] DELETE /identity/v3/projects/9de231abcd4546c3ba12371ac0feb5d2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:01.786710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.786710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.786710 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.839729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:01.841592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.854402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1001/1985] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:01.862450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 985/1986] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/projects => generated 367 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:01.862654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:01.864278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.865971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.874395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:01.877636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:01.883023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87989f-4418-4c32-bf21-cb38d123c81c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.948491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.949184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54879ef7-d1a5-492e-bb69-79c5f8b93dc5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:01.949299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.949593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.950501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.956234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.956234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:01.958997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:01.959777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:01.960071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:01.960357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:01.972137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:01.973621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.004164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 986/1987] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:02.060479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.061072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1002/1988] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:01 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:02.074551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239b2b5-0867-4151-98ee-d0a53472a405 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.088114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.088811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.089103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.089472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.090165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.092451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.124863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 987/1989] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:02.130854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.145658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b5e04-4d1f-4f98-980f-059ece8289ea admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.154090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ae996-1507-4c0e-991a-8d38fe14194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.154734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae996-1507-4c0e-991a-8d38fe14194a admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.155015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae996-1507-4c0e-991a-8d38fe14194a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.155276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ae996-1507-4c0e-991a-8d38fe14194a admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.156252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae996-1507-4c0e-991a-8d38fe14194a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.158284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ae996-1507-4c0e-991a-8d38fe14194a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.182678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1003/1990] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:02.182898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.201084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4df3b1-f4a2-4fe0-8235-e65b2dc1962d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.206503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.223160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.223160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.223160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] PATH_INFO: `/v3/projects/c6da277cd71a42c1b8ea70bf8eef4263/users/999810a12303463d913b7c7c887fd508/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.232455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6da277cd71a42c1b8ea70bf8eef4263, user_id=999810a12303463d913b7c7c887fd508, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.239485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.358415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 988/1991] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:02 2022] PUT /identity/v3/projects/c6da277cd71a42c1b8ea70bf8eef4263/users/999810a12303463d913b7c7c887fd508/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:02.370206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.370504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.370784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.403999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] MFA Rules not processed for user `999810a12303463d913b7c7c887fd508`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:02.405266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.501640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1004/1992] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:02.509634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.576405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89340-f813-4ddd-8933-7db2490604ed admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.581998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:02.584438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.585062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.585344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.585619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.586280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.588214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.739220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 989/1993] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:02.743629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.756451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecb4d2-8e39-400b-98d4-5a81f6d11bba None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.781059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:02.783458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:02.849801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.850781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.851274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.851730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.852566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.854807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:02.872340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856785-26f6-4c97-990a-e1c0112fda26 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:02.879404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:02.880051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:02.880342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:02.880625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] PATH_INFO: `/v3/users/48fa59dc05f0494a85635254682d0687` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:02.881833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=48fa59dc05f0494a85635254682d0687)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:02.883742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.039725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1005/1994] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:02 2022] POST /identity/v3/users => generated 289 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:03.043523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.046448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.060589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3f208-18aa-496f-985d-8145aceb10d3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.065916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.066559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.066908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.067195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] PATH_INFO: `/v3/users/7c642adf934f45fb88e6f92a9dab3cca` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.068377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c642adf934f45fb88e6f92a9dab3cca)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.070344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.111146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48fa59dc05f0494a85635254682d0687'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.111830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48fa59dc05f0494a85635254682d0687'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.112470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48fa59dc05f0494a85635254682d0687'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.130689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48fa59dc05f0494a85635254682d0687'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.197979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48fa59dc05f0494a85635254682d0687'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.211604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 990/1995] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:02 2022] DELETE /identity/v3/users/48fa59dc05f0494a85635254682d0687 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:03.212576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.214277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.315219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c642adf934f45fb88e6f92a9dab3cca'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.316939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c642adf934f45fb88e6f92a9dab3cca'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.317625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c642adf934f45fb88e6f92a9dab3cca'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.334437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c642adf934f45fb88e6f92a9dab3cca'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.339038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe6501-03da-437e-b52a-f03d2f3b83ff admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.344799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3acbb-ab1b-41f6-92b1-40d06cc6759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.351276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3acbb-ab1b-41f6-92b1-40d06cc6759b admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.351276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3acbb-ab1b-41f6-92b1-40d06cc6759b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.351276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3acbb-ab1b-41f6-92b1-40d06cc6759b admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.351276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3acbb-ab1b-41f6-92b1-40d06cc6759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.351276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3acbb-ab1b-41f6-92b1-40d06cc6759b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.361654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 991/1996] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:03.366387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.366752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.367295 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.388561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:03.389909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.397824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c642adf934f45fb88e6f92a9dab3cca'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:03.398083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 992/1997] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:03.399454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.400547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.412730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1633-feba-47bf-a2bc-6d9056b0605e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.418465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1006/1998] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:03 2022] DELETE /identity/v3/users/7c642adf934f45fb88e6f92a9dab3cca => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:03.420514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.423684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.430107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d189a-ffb4-4bb6-a01d-10a98e41a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.431925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d189a-ffb4-4bb6-a01d-10a98e41a39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.431925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d189a-ffb4-4bb6-a01d-10a98e41a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.431925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d189a-ffb4-4bb6-a01d-10a98e41a39b admin admin] PATH_INFO: `/v3/projects/48427cdfdb8a4334a89da73a482cc776/users/19b7205d406a4c3f902f79ddd4acb365/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.454138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d189a-ffb4-4bb6-a01d-10a98e41a39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48427cdfdb8a4334a89da73a482cc776, user_id=19b7205d406a4c3f902f79ddd4acb365, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.458191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d189a-ffb4-4bb6-a01d-10a98e41a39b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.469628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:03.509650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b05b8-c998-4fe4-b9bb-436aa8923f91 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.510169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.510951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.511396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.511667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.536084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 993/1999] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:03 2022] PUT /identity/v3/projects/48427cdfdb8a4334a89da73a482cc776/users/19b7205d406a4c3f902f79ddd4acb365/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:03.537867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.538112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.538481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.564711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:03.567527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.619187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.622839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.638125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1007/2000] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:03.639621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.654138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18653d2f-5ceb-47a0-853a-93aa30843c30 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.660792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 994/2001] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:03.662283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.666006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.666460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.666840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.667812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.670332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.674261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.675985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.686129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1008/2002] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:03.689985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:03.703665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb3cb8-ac7a-4abe-a40f-68e2124c1776 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.710979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08f1d-fb2d-43f7-a1b0-4f66b55569e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.712220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08f1d-fb2d-43f7-a1b0-4f66b55569e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.712738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08f1d-fb2d-43f7-a1b0-4f66b55569e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.713223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08f1d-fb2d-43f7-a1b0-4f66b55569e5 admin admin] PATH_INFO: `/v3/projects/48427cdfdb8a4334a89da73a482cc776/users/19b7205d406a4c3f902f79ddd4acb365/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.716725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b08f1d-fb2d-43f7-a1b0-4f66b55569e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48427cdfdb8a4334a89da73a482cc776, user_id=19b7205d406a4c3f902f79ddd4acb365, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.719860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b08f1d-fb2d-43f7-a1b0-4f66b55569e5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.736645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1009/2003] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:03 2022] PUT /identity/v3/projects/48427cdfdb8a4334a89da73a482cc776/users/19b7205d406a4c3f902f79ddd4acb365/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:03.754918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.756081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.756596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.766931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcedd-c2b8-4d9c-ac82-e52cc2cf08f4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:03.830418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] MFA Rules not processed for user `19b7205d406a4c3f902f79ddd4acb365`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:03.833359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:03.834202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:03.834590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:03.834878 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:03.835084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:03.922805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:03.924452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:03.952505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 995/2004] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:03.991734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1010/2005] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:04.014170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.019324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.120446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c57b5-6454-4d1f-bca3-09c6eea13a5b service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.125440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.126110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.126396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.126738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.139183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.140655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.152872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 996/2006] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:04.437256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.471297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb99c4-5606-4282-97c6-1533d65050e3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.489680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.492640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.492640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.493502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.498389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.550089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.550089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.586165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aecdd2-0cb8-4417-8447-67d1835d35eb service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.592133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.592794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.593074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.593345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] PATH_INFO: `/v3/projects/19e7d938a3f94befad02f4b05cd2ab54` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.594556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e7d938a3f94befad02f4b05cd2ab54)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.596520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.636181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.641665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.650811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1011/2007] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:04.726095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e7d938a3f94befad02f4b05cd2ab54', 'request_id': 'req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.733720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:04.736038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e7d938a3f94befad02f4b05cd2ab54', 'request_id': 'req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.744318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e7d938a3f94befad02f4b05cd2ab54', 'request_id': 'req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.849133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.850580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.858445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] The token cache is being invalidate because project 19e7d938a3f94befad02f4b05cd2ab54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:04.864253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.864253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:04.864253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 997/2008] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:04 2022] DELETE /identity/v3/projects/19e7d938a3f94befad02f4b05cd2ab54 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:04.867363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:04.870307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:04.876086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1ab07-941a-403d-86f3-1f35211a871d service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.981031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510ebc7-5919-491d-a6a0-2f8b6bbb2ae5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:04.981804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.982614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.983196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.983487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] PATH_INFO: `/v3/projects/a28780c8daef4bacb9e46ca3a6645616` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.984961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a28780c8daef4bacb9e46ca3a6645616)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.986097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:04.986743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:04.987031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:04.987227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:04.987361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] PATH_INFO: `/v3/users/ef024eddacfd429eb22d61bfbe590cfb` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:04.988713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef024eddacfd429eb22d61bfbe590cfb)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:04.991179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.259030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a28780c8daef4bacb9e46ca3a6645616', 'request_id': 'req-84989df1-a86a-4a49-afb3-714e939b8317'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.260321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef024eddacfd429eb22d61bfbe590cfb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.261000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef024eddacfd429eb22d61bfbe590cfb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.261627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef024eddacfd429eb22d61bfbe590cfb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.266200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a28780c8daef4bacb9e46ca3a6645616', 'request_id': 'req-84989df1-a86a-4a49-afb3-714e939b8317'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.276926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef024eddacfd429eb22d61bfbe590cfb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.348166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a28780c8daef4bacb9e46ca3a6645616', 'request_id': 'req-84989df1-a86a-4a49-afb3-714e939b8317'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.359479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] The token cache is being invalidate because project a28780c8daef4bacb9e46ca3a6645616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:05.359774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.360429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-84989df1-a86a-4a49-afb3-714e939b8317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.362074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1012/2009] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:04 2022] DELETE /identity/v3/projects/a28780c8daef4bacb9e46ca3a6645616 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:05.363310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.363595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.363872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.395915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] MFA Rules not processed for user `3589f2353d224fea87a654dd098b69a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:05.397129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.409497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef024eddacfd429eb22d61bfbe590cfb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.429161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 998/2010] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:04 2022] DELETE /identity/v3/users/ef024eddacfd429eb22d61bfbe590cfb => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:05.430673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.435635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.475768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1013/2011] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:05.487891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.489550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.511074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd546e9c-e498-4191-891d-8edb3211ee26 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.517680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.518668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.519177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.520149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] PATH_INFO: `/v3/users/4d6982b92b914d3ca2fc1448de7a2494` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.521451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6982b92b914d3ca2fc1448de7a2494)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.524670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.555922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc64cc-f74d-44dd-8094-d4aa86267fae None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:05.564420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:05.608223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:05.608866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:05.609140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:05.609407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:05.673887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:05.675786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:05.691262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1014/2012] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:05.753029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6982b92b914d3ca2fc1448de7a2494'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.754088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6982b92b914d3ca2fc1448de7a2494'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.754907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6982b92b914d3ca2fc1448de7a2494'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.764007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:05.770780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6982b92b914d3ca2fc1448de7a2494'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.900952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b480122-bd28-4fbf-8c0d-fff70441c03e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6982b92b914d3ca2fc1448de7a2494'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:05.915637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 999/2013] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:05 2022] DELETE /identity/v3/users/4d6982b92b914d3ca2fc1448de7a2494 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:05.915859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:05.917413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:05.933088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787104fd-3e69-4bbe-a059-aebea254a795 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.004476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.005114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.005390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.005660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] PATH_INFO: `/v3/projects/5ca67771332444ae99ef0ddf5a076633` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.006818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca67771332444ae99ef0ddf5a076633)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.008800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.223828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca67771332444ae99ef0ddf5a076633', 'request_id': 'req-bd706789-e2e9-437a-82e7-bb26968e802d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.231738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca67771332444ae99ef0ddf5a076633', 'request_id': 'req-bd706789-e2e9-437a-82e7-bb26968e802d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.369751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca67771332444ae99ef0ddf5a076633', 'request_id': 'req-bd706789-e2e9-437a-82e7-bb26968e802d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.381793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] The token cache is being invalidate because project 5ca67771332444ae99ef0ddf5a076633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:06.382173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.382896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bd706789-e2e9-437a-82e7-bb26968e802d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.384473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1015/2014] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:05 2022] DELETE /identity/v3/projects/5ca67771332444ae99ef0ddf5a076633 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:06.389871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.390163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.390439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.413568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:06.414840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.502437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1000/2015] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:06.509349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.509880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.509991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.531638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:06.537043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.541300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1016/2016] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:06.545605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.558915 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b03b-7dff-4233-8452-b03cb8c34403 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.572129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.572129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.572129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.572129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.572956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:06.572956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.572956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.583317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1001/2017] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:06.587653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.600455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4301bea-45ba-4c7d-b84d-9bf2280b49fe None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.605952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.606746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.606863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.607128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.607748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.609715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.634909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.641309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:06.657954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4a7c-233d-4210-879b-5bcbba07a054 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.665814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.666882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.667390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.667894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] PATH_INFO: `/v3/projects/b84f9dd00b7442e78a0beb4286bd6e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.670149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84f9dd00b7442e78a0beb4286bd6e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.672822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.729324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1017/2018] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:06.733250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.796907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b99b7-970b-4a59-a334-20b0cb9eff18 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.801662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:06.802333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.802612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.802964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.803753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:06.805652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:06.824664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'request_id': 'req-bc183511-d9be-4824-80f1-701d02b645ea'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.834858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'request_id': 'req-bc183511-d9be-4824-80f1-701d02b645ea'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.842418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84f9dd00b7442e78a0beb4286bd6e5d', 'request_id': 'req-bc183511-d9be-4824-80f1-701d02b645ea'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.933290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] The token cache is being invalidate because project b84f9dd00b7442e78a0beb4286bd6e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:06.938252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1018/2019] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:06.940060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:06.941038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.942552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc183511-d9be-4824-80f1-701d02b645ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:06.951461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1002/2020] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:06 2022] DELETE /identity/v3/projects/b84f9dd00b7442e78a0beb4286bd6e5d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:06.953213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb227-400d-4a44-9fac-77e32c509af3 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:06.953636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb227-400d-4a44-9fac-77e32c509af3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:06.954126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb227-400d-4a44-9fac-77e32c509af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:06.956926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aec55bf-e421-49c3-8052-3f7a60f79c85 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:06.977074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-917eb227-400d-4a44-9fac-77e32c509af3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:06.978505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-917eb227-400d-4a44-9fac-77e32c509af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.026631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.027651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.028172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.028532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.029210 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.031005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.045706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1019/2021] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:07.046993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.048765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.048904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1003/2022] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:07.056998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.057322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.057574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.062960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec884c-63ca-4f08-b9c4-c82a34d6161c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.069462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.070333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.070582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.079394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.079394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.079394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.079702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:07.080761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.089183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1020/2023] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:07.090355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.092786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1004/2024] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:07.098107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.101397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e5261-7eb5-4360-bd62-2c58441efabe admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.107337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9193ba-8248-4349-a08e-b4c8c589d897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.110278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9193ba-8248-4349-a08e-b4c8c589d897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.110278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9193ba-8248-4349-a08e-b4c8c589d897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.110278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9193ba-8248-4349-a08e-b4c8c589d897 admin admin] PATH_INFO: `/v3/projects/35581a3a6a5144cb87f53acf9d94c81a/users/232c69a1806849d49d2e738ec5c19fe5/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.112154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88996e-2cb6-4673-acb5-a7b2c87751dd None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.118601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.119389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.119672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.119945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.120601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:07.120914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.123375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.126861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9193ba-8248-4349-a08e-b4c8c589d897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35581a3a6a5144cb87f53acf9d94c81a, user_id=232c69a1806849d49d2e738ec5c19fe5, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.131331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9193ba-8248-4349-a08e-b4c8c589d897 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.139883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1005/2025] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:07.141348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.152194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a15bc-9566-47dd-8321-7604777179f5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.157409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.161948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.161948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.161948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.161948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.161948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.215829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1021/2026] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:07 2022] PUT /identity/v3/projects/35581a3a6a5144cb87f53acf9d94c81a/users/232c69a1806849d49d2e738ec5c19fe5/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:07.227593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.227875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.228158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.258388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] MFA Rules not processed for user `232c69a1806849d49d2e738ec5c19fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:07.259653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.326992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1006/2027] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:07 2022] POST /identity/v3/projects => generated 401 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:07.332634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.336507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1022/2028] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:07.347076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.349124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.349672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:07.406889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fb815-d176-4622-b8f2-e5601831cc2a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.414337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.415210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.415857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.416270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.417059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.419932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.426384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6744164-75ee-4ee1-a6a9-e19f55dd8807 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.475208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.475758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.476035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.476306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.490414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1007/2029] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:07 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:07.494141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.505188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c4445-a0ce-435b-9325-f8ca7e7965df admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.510854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.511481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.512393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.512782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.513435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.515191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.530291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1008/2030] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:07.531272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.548278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0db85-2c69-47ff-a548-788c10e3766d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.553415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.554902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.569839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba12ad7-e501-4ba1-adc6-ca4c4a5c64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.569839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12ad7-e501-4ba1-adc6-ca4c4a5c64ff admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.569839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12ad7-e501-4ba1-adc6-ca4c4a5c64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.569839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba12ad7-e501-4ba1-adc6-ca4c4a5c64ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.570533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba12ad7-e501-4ba1-adc6-ca4c4a5c64ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.570533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba12ad7-e501-4ba1-adc6-ca4c4a5c64ff admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.570677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1023/2031] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:07.577320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1009/2032] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:07.581714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:07.597172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9af51f-26dc-4452-8d78-233b73dc6c43 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:07.602389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:07.602955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.603230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.603500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] PATH_INFO: `/v3/projects/b8e8efcacd2c4842a5283f05627b9450/users/dc7d327abe184570a483df902f2f492f/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.624835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e8efcacd2c4842a5283f05627b9450, user_id=dc7d327abe184570a483df902f2f492f, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:07.628894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:07.741897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1024/2033] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:07 2022] PUT /identity/v3/projects/b8e8efcacd2c4842a5283f05627b9450/users/dc7d327abe184570a483df902f2f492f/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:07.748943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:07.749558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:07.750418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:07.784467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] MFA Rules not processed for user `dc7d327abe184570a483df902f2f492f`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:07.786052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:07.905724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1010/2034] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:07.910717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.019170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48fa25-f145-43ea-afb0-8031f86b8780 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.025853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd7804-fc4e-4b76-9cc8-1b33c1363c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.026476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7804-fc4e-4b76-9cc8-1b33c1363c03 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.026797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7804-fc4e-4b76-9cc8-1b33c1363c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.027074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd7804-fc4e-4b76-9cc8-1b33c1363c03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.028412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7804-fc4e-4b76-9cc8-1b33c1363c03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.030509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd7804-fc4e-4b76-9cc8-1b33c1363c03 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.090657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:08.104734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1025/2035] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:07 2022] POST /identity/v3/projects => generated 399 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:08.108967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.126420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d815460-29cc-40b5-80b5-1fc0aff84ed0 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.204511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.204853 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.205075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.231650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.232294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.232581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.232853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.233577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.239697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.270091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] MFA Rules not processed for user `3589f2353d224fea87a654dd098b69a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:08.272511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.350944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1026/2036] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:08.377601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1011/2037] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:08 2022] POST /identity/v3/users => generated 306 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:08.378764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.392284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8763710-7fa8-44e0-bdd0-64189b7e1a4e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.397713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.398642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.398930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.399551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.400259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.402357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.417503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1027/2038] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:08.421274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.446268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dda9dc-df9e-45da-ae5e-0f8c36a8ec27 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.456434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.456434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.456434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.456434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] PATH_INFO: `/v3/projects/89b96b52aafe4ad6976ddd858047a184/users/926b6e4912f4426387765eafc21806e5/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.480525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:08.489453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b96b52aafe4ad6976ddd858047a184, user_id=926b6e4912f4426387765eafc21806e5, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.492223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.565700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1012/2039] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:08 2022] PUT /identity/v3/projects/89b96b52aafe4ad6976ddd858047a184/users/926b6e4912f4426387765eafc21806e5/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:08.569794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.580682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9dcef-17bc-48b6-abf4-a4c0125b8360 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.664578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55751eb3-2ab1-494c-9371-f31f7139c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.665041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55751eb3-2ab1-494c-9371-f31f7139c7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.665368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55751eb3-2ab1-494c-9371-f31f7139c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.665640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55751eb3-2ab1-494c-9371-f31f7139c7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.666583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55751eb3-2ab1-494c-9371-f31f7139c7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.668881 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55751eb3-2ab1-494c-9371-f31f7139c7bb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.683702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1028/2040] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:08.691071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.705108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6a05-41e9-4e8b-8c82-c9b8729750d0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.715354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.716553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.716932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.717248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] PATH_INFO: `/v3/projects/89b96b52aafe4ad6976ddd858047a184/users/926b6e4912f4426387765eafc21806e5/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.719788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b96b52aafe4ad6976ddd858047a184, user_id=926b6e4912f4426387765eafc21806e5, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.722892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:08.735852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1013/2041] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:08 2022] PUT /identity/v3/projects/89b96b52aafe4ad6976ddd858047a184/users/926b6e4912f4426387765eafc21806e5/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:08.748681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.748963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.749291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.782351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] MFA Rules not processed for user `926b6e4912f4426387765eafc21806e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:08.783758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.863429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1029/2042] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:08.875258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:08.877312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:08.973858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5f2a0-dfa1-463b-a739-21ceabcab340 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:08.983868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:08.984464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:08.984952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:08.985359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:08.997324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:08.998996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.012247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1014/2043] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:09.147188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:09.236876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:09.246623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db354-dbab-41a7-959f-6c526f507484 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:09.250372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:09.250979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:09.251259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:09.251534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:09.321015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:09.322839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:09.335048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1030/2044] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:10.239342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:11.118940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:11.121365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:11.230268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59045bdc-5f7f-49cd-a27e-4ec2633d25ef service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:11.243660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:11.244501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:11.245082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:11.245690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] PATH_INFO: `/v3/users/c5f442c825a04800b4550135f4d2cadc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:11.249013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f442c825a04800b4550135f4d2cadc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:11.251450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:11.382154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:11.453677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f442c825a04800b4550135f4d2cadc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.454553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f442c825a04800b4550135f4d2cadc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.455241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f442c825a04800b4550135f4d2cadc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.469819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f442c825a04800b4550135f4d2cadc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.547401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1acce5b5-a4fe-4b40-96d8-98dcaf4e4090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f442c825a04800b4550135f4d2cadc'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:11.564899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1015/2045] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:11 2022] DELETE /identity/v3/users/c5f442c825a04800b4550135f4d2cadc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:11.735968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:11.886751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:11.897736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511a82f-ca19-43ad-b8c4-19820da346c9 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:11.959409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:11.960072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:11.960354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:11.960630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] PATH_INFO: `/v3/projects/33c96c7d16c443bc8a2594a7a9a12c76` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:11.961892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c96c7d16c443bc8a2594a7a9a12c76)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:11.964171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.081555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c96c7d16c443bc8a2594a7a9a12c76', 'request_id': 'req-2836b572-316a-430d-9557-4d6934b85635'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.087999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c96c7d16c443bc8a2594a7a9a12c76', 'request_id': 'req-2836b572-316a-430d-9557-4d6934b85635'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.166131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c96c7d16c443bc8a2594a7a9a12c76', 'request_id': 'req-2836b572-316a-430d-9557-4d6934b85635'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.178829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] The token cache is being invalidate because project 33c96c7d16c443bc8a2594a7a9a12c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:12.179130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.179803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2836b572-316a-430d-9557-4d6934b85635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:12.184402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1031/2046] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:11 2022] DELETE /identity/v3/projects/33c96c7d16c443bc8a2594a7a9a12c76 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:12.186733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.187132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.187524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.208894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:12.210581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.273444 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1016/2047] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:12.281903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.282183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.282470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.311158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:12.313841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:12.327396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1032/2048] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:12.334059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.348531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d41a6-29d0-4272-a4cd-b5a673555766 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.353848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.354480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.354761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.355030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.355841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:12.356151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.358053 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.374737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1017/2049] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:12.379457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.391591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4990e-4fc7-4235-96b2-13ebd9b070d5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.398435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.399114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.399402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.399988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.400703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.404903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.569113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1033/2050] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:12.570425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.583100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82142cc8-65b5-452e-b6fa-80a2a8215e8d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.650647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.651251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.651543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.651816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.652460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.655632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.765325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1018/2051] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:12.765510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.777661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7fca6-4f68-45ff-b7a4-6d8ebc5eba1b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.783664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.784569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.784929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.785514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.786295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.788053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.799499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1034/2052] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:12.809904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.821319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16534dfa-cd55-443e-8f4d-9cb0c5225a3d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.826867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca2dad-18e8-425e-a13e-8c7209ece591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.827492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca2dad-18e8-425e-a13e-8c7209ece591 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.827796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca2dad-18e8-425e-a13e-8c7209ece591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.828061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca2dad-18e8-425e-a13e-8c7209ece591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.828704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca2dad-18e8-425e-a13e-8c7209ece591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.830353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca2dad-18e8-425e-a13e-8c7209ece591 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.842041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1019/2053] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:12.846389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:12.862146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfd176-ef56-481a-942c-52f48af195df admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:12.863394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:12.864131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.864630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.865523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] PATH_INFO: `/v3/projects/b8e2111317f44f828a0bbcca6db7e109/users/dd8808dab1914b269a80addf376bab0c/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.886768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e2111317f44f828a0bbcca6db7e109, user_id=dd8808dab1914b269a80addf376bab0c, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:12.889842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:12.948991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1035/2054] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:12 2022] PUT /identity/v3/projects/b8e2111317f44f828a0bbcca6db7e109/users/dd8808dab1914b269a80addf376bab0c/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:12.954359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:12.954649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:12.955116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:12.980193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:12.981335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.065976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1020/2055] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:13.078060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.080610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.151249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81fe2f8-be9e-4469-babc-fc7f20eeb891 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.157960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e562fb-4ae9-4f7c-b17f-6106ecf8bf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.157960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e562fb-4ae9-4f7c-b17f-6106ecf8bf4e service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.157960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e562fb-4ae9-4f7c-b17f-6106ecf8bf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.157960 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e562fb-4ae9-4f7c-b17f-6106ecf8bf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.175753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e562fb-4ae9-4f7c-b17f-6106ecf8bf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.177516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e562fb-4ae9-4f7c-b17f-6106ecf8bf4e service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.188145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.189645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.190978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1036/2056] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:13.202617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4453-d827-4bc1-922d-be89f28552f1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.208043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.211997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.211997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.211997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] PATH_INFO: `/v3/users/999810a12303463d913b7c7c887fd508` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.211997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999810a12303463d913b7c7c887fd508)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.212889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.462186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:13.477079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999810a12303463d913b7c7c887fd508'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.477695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999810a12303463d913b7c7c887fd508'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.478519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999810a12303463d913b7c7c887fd508'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.490524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999810a12303463d913b7c7c887fd508'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.598906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999810a12303463d913b7c7c887fd508'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:13.616388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1021/2057] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:13 2022] DELETE /identity/v3/users/999810a12303463d913b7c7c887fd508 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:13.621656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.622272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.623465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.652310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:13.656966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.745503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1037/2058] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:13.756375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:13.760177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:13.821121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dabc16a-6604-4ef3-b2d1-4112b43f22f7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:13.825755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:13.827338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:13.827624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:13.834824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:13.839861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:13.841526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:13.855424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1022/2059] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:14.022308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:14.609562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.609562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:14.622104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dabb8e-3573-41ab-a44c-63bf3eb8be56 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:14.630554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:14.631436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:14.631723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:14.632053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] PATH_INFO: `/v3/projects/c6da277cd71a42c1b8ea70bf8eef4263` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:14.633390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6da277cd71a42c1b8ea70bf8eef4263)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:14.635505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:14.814787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6da277cd71a42c1b8ea70bf8eef4263', 'request_id': 'req-3573c1d9-2604-49ae-b099-498f824be44f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.821692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6da277cd71a42c1b8ea70bf8eef4263', 'request_id': 'req-3573c1d9-2604-49ae-b099-498f824be44f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.913281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6da277cd71a42c1b8ea70bf8eef4263', 'request_id': 'req-3573c1d9-2604-49ae-b099-498f824be44f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.926703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] The token cache is being invalidate because project c6da277cd71a42c1b8ea70bf8eef4263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:14.927003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.928261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:14.930744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1038/2060] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:14 2022] DELETE /identity/v3/projects/c6da277cd71a42c1b8ea70bf8eef4263 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:14.935082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:14.946836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc45b88-7a8d-48a4-9afe-570ce3ed86dd service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:15.025624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:15.026657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:15.027013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:15.027414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] PATH_INFO: `/v3/users/19b7205d406a4c3f902f79ddd4acb365` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:15.028795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b7205d406a4c3f902f79ddd4acb365)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:15.031058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:15.240969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b7205d406a4c3f902f79ddd4acb365'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:15.242640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b7205d406a4c3f902f79ddd4acb365'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:15.243674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b7205d406a4c3f902f79ddd4acb365'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:15.262269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b7205d406a4c3f902f79ddd4acb365'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:15.334459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b7205d406a4c3f902f79ddd4acb365'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:15.363528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1023/2061] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:14 2022] DELETE /identity/v3/users/19b7205d406a4c3f902f79ddd4acb365 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:15.542315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:15.782064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:15.893859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:15.895331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:15.921884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573c1d9-2604-49ae-b099-498f824be44f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.084055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.087563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.087563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.087563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] PATH_INFO: `/v3/projects/48427cdfdb8a4334a89da73a482cc776` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.089964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48427cdfdb8a4334a89da73a482cc776)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.092647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.184138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.186845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.200291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6350fd8-978e-46d1-8b99-24c1dc9a21f9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.205426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.206108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.206392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.206718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] PATH_INFO: `/v3/users/dc7d327abe184570a483df902f2f492f` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.207933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7d327abe184570a483df902f2f492f)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.209989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.308893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48427cdfdb8a4334a89da73a482cc776', 'request_id': 'req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.315209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48427cdfdb8a4334a89da73a482cc776', 'request_id': 'req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.412749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48427cdfdb8a4334a89da73a482cc776', 'request_id': 'req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.432385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7d327abe184570a483df902f2f492f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.433213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7d327abe184570a483df902f2f492f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.434073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7d327abe184570a483df902f2f492f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.434751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] The token cache is being invalidate because project 48427cdfdb8a4334a89da73a482cc776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:16.435063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.436057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-ac2af1c4-d846-46e8-8b5b-0e3b3e34b103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.437692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1039/2062] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:15 2022] DELETE /identity/v3/projects/48427cdfdb8a4334a89da73a482cc776 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:16.443850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.444379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.444814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.464510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7d327abe184570a483df902f2f492f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.472953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:16.474443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.549113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1040/2063] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:16.550393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.557070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.569266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d426200-5ef3-4fbb-88be-84800e8761c6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.570601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c6babeb5-825b-47cc-b3ba-3a687dc464e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7d327abe184570a483df902f2f492f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.574575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.575226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.575519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.575773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] PATH_INFO: `/v3/users/232c69a1806849d49d2e738ec5c19fe5` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.576979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232c69a1806849d49d2e738ec5c19fe5)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.578954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.595155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1024/2064] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:16 2022] DELETE /identity/v3/users/dc7d327abe184570a483df902f2f492f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:16.596770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f5b20-cbe9-4801-b90e-b6d9ad13893d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.597910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f5b20-cbe9-4801-b90e-b6d9ad13893d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.598265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f5b20-cbe9-4801-b90e-b6d9ad13893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.629004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b60f5b20-cbe9-4801-b90e-b6d9ad13893d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:16.630839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b60f5b20-cbe9-4801-b90e-b6d9ad13893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.697612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1025/2065] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:16.699112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.699465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.699811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.720858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:16.722276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.734599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1026/2066] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:16.737271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.750000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232c69a1806849d49d2e738ec5c19fe5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.750676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232c69a1806849d49d2e738ec5c19fe5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.751348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232c69a1806849d49d2e738ec5c19fe5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.753322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f177a99-c2d7-487c-8f5a-2acea956e2c8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.759424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.760191 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.760665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.761353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.762610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:16.762928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.765584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.769033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232c69a1806849d49d2e738ec5c19fe5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.789363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1027/2067] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:16.789363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.789680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.863884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f49e24-6324-411d-baab-713ceed8b1d7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:16.867690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232c69a1806849d49d2e738ec5c19fe5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:16.877975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:16.878639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.878923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.879209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.880983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.887002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1041/2068] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:16 2022] DELETE /identity/v3/users/232c69a1806849d49d2e738ec5c19fe5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:16.892335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:16.894581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.898717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:16.901270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef597c9a-e029-473c-9d1f-f5720667ff84 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:16.918986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1028/2069] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:16.928380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:16.928674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:16.928955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:16.973337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:16.974618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:16.983536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1029/2070] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:16.996757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3768ba-9eac-4cf5-9ea0-fb8eeb831519 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.002648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.003274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.003551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.003824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.004460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.005506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.006994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.095796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c839a9-64c1-479e-af58-f70844485e27 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.101017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.101883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.102171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.102445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.113899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.115366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.116892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1042/2071] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:16 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:17.122820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.127718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1030/2072] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:17.276892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b8295-e40b-4a2b-87f3-99cff7497b4c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.290492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.291806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.293807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.293807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.294741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.319053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.409051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1043/2073] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:17 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:17.417184 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.433833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3e149-4e20-431f-8750-911fffea3acb service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.446704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.455964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.455964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.455964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.455964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.459349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.473923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1031/2074] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:17.478729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.490235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80abefdf-97c0-4e67-b548-08db576374b9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.497810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.498184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.498884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.498884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.499666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.501502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.523238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1044/2075] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:17.523429 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.544133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c9522-dafe-4118-8778-6365f7ea21c3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.556493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00999af-2e24-4251-b96d-cdfce7185fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.558088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00999af-2e24-4251-b96d-cdfce7185fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.558373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00999af-2e24-4251-b96d-cdfce7185fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.558797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00999af-2e24-4251-b96d-cdfce7185fe9 admin admin] PATH_INFO: `/v3/projects/73ad45512195494b897b7ebf01db3ab6/users/f418766dfa5941e59c29d47923b10560/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.578131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00999af-2e24-4251-b96d-cdfce7185fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ad45512195494b897b7ebf01db3ab6, user_id=f418766dfa5941e59c29d47923b10560, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.581127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00999af-2e24-4251-b96d-cdfce7185fe9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.631738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:17.635701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1032/2076] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:17 2022] PUT /identity/v3/projects/73ad45512195494b897b7ebf01db3ab6/users/f418766dfa5941e59c29d47923b10560/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:17.640617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.642649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.650933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.651434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.652621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.668035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb459e7-d4e5-4b7d-9959-9ee98a78f757 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.703928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] MFA Rules not processed for user `f418766dfa5941e59c29d47923b10560`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:17.705904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:17.797624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.798768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.799123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.799810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] PATH_INFO: `/v3/projects/b8e8efcacd2c4842a5283f05627b9450` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.802659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e8efcacd2c4842a5283f05627b9450)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.807771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.828795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:17.850464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1033/2077] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:17.854932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:17.876595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf8bc6-3cca-4640-9e43-78df80a92fc1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:17.882695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:17.883481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:17.883887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:17.884339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:17.885136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:17.887321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:17.980541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e8efcacd2c4842a5283f05627b9450', 'request_id': 'req-14463d82-6cdf-476f-9072-c212dead0131'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:17.980541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e8efcacd2c4842a5283f05627b9450', 'request_id': 'req-14463d82-6cdf-476f-9072-c212dead0131'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.020193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1034/2078] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:17 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:18.024264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.056596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e8efcacd2c4842a5283f05627b9450', 'request_id': 'req-14463d82-6cdf-476f-9072-c212dead0131'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.074904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] The token cache is being invalidate because project b8e8efcacd2c4842a5283f05627b9450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:18.075328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.076186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.080291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1045/2079] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:17 2022] DELETE /identity/v3/projects/b8e8efcacd2c4842a5283f05627b9450 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:18.085395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.089802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.113049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3866f8-67c2-4f1f-84c6-9702f8e10919 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.118273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.118903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.119189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.119470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.120112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.122278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.183142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14463d82-6cdf-476f-9072-c212dead0131 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.191108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.192249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.192701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.193173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] PATH_INFO: `/v3/users/926b6e4912f4426387765eafc21806e5` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.194597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926b6e4912f4426387765eafc21806e5)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.197162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.233142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1035/2080] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:18.233142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.241536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.258056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f99b-b966-47eb-8312-b3d52429eba0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.263361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.263690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.264027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.264954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] PATH_INFO: `/v3/projects/35581a3a6a5144cb87f53acf9d94c81a` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.266167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35581a3a6a5144cb87f53acf9d94c81a)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.268159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.381946 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35581a3a6a5144cb87f53acf9d94c81a', 'request_id': 'req-3cb7690d-d601-42d8-9682-71cc8e8ed19d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.383751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926b6e4912f4426387765eafc21806e5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.385105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926b6e4912f4426387765eafc21806e5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.386708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926b6e4912f4426387765eafc21806e5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.389873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35581a3a6a5144cb87f53acf9d94c81a', 'request_id': 'req-3cb7690d-d601-42d8-9682-71cc8e8ed19d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.396086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35581a3a6a5144cb87f53acf9d94c81a', 'request_id': 'req-3cb7690d-d601-42d8-9682-71cc8e8ed19d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.407003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926b6e4912f4426387765eafc21806e5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.474768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] The token cache is being invalidate because project 35581a3a6a5144cb87f53acf9d94c81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:18.475330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.475762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.477416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1036/2081] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:18 2022] DELETE /identity/v3/projects/35581a3a6a5144cb87f53acf9d94c81a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:18.480969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.480969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.554879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-352a4a24-5119-445f-813b-d0571f1989a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926b6e4912f4426387765eafc21806e5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:18.558669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7690d-d601-42d8-9682-71cc8e8ed19d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.565760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.566481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.566761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.567064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.567766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.569754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.575921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1046/2082] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:18 2022] DELETE /identity/v3/users/926b6e4912f4426387765eafc21806e5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:18.578783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094447-0df5-4c90-b374-2cb498489097 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.579577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094447-0df5-4c90-b374-2cb498489097 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.581699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9094447-0df5-4c90-b374-2cb498489097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.587835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1037/2083] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:18.592805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.619206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f629dd-f2fe-40a8-a497-bd5289f44263 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.620024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f9094447-0df5-4c90-b374-2cb498489097 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:18.628067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f9094447-0df5-4c90-b374-2cb498489097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.706567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1047/2084] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:18.707096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.708378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.708862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.709155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] PATH_INFO: `/v3/projects/9f88b5a3a9e54b6093ac93437194a76d/users/882cc2aef0db4e0d8a8c066527dab021/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.715021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.718223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.718223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.733612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f88b5a3a9e54b6093ac93437194a76d, user_id=882cc2aef0db4e0d8a8c066527dab021, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.736553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.739701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:18.741438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:18.752706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1048/2085] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:18.756569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.766675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab99cb-856b-4bfe-b59c-ef2a0354f34b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.771670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.772299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.772577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.773378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.773496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:18.773832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.775930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.790209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1049/2086] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:18.804280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.814781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd208-f130-4d1a-a233-4b9fbb49859e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:18.820349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:18.820975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:18.821351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:18.821844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:18.822659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:18.824703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:18.863217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1038/2087] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:18 2022] PUT /identity/v3/projects/9f88b5a3a9e54b6093ac93437194a76d/users/882cc2aef0db4e0d8a8c066527dab021/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:18.867407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.933623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1050/2088] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:18.938301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:18.949024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afade43-92d0-4df2-a316-31430117ff2a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.031138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.032688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.033141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.033336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.033970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.035630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.050270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1039/2089] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:19.064855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.087699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547066d3-50a1-423c-97b0-7d622261f280 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.094710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3ff8f-f37f-4a4f-9a2f-821866a3755f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.101299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.101299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.101299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.101299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.101698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.102593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff6f6f-9611-40c0-ab84-7bcb8b20b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.103455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff6f6f-9611-40c0-ab84-7bcb8b20b5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.103839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff6f6f-9611-40c0-ab84-7bcb8b20b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.104216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff6f6f-9611-40c0-ab84-7bcb8b20b5a3 admin admin] PATH_INFO: `/v3/projects/9f88b5a3a9e54b6093ac93437194a76d/users/882cc2aef0db4e0d8a8c066527dab021/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.107829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff6f6f-9611-40c0-ab84-7bcb8b20b5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f88b5a3a9e54b6093ac93437194a76d, user_id=882cc2aef0db4e0d8a8c066527dab021, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.110124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff6f6f-9611-40c0-ab84-7bcb8b20b5a3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.114426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.124240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1040/2090] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:19 2022] PUT /identity/v3/projects/9f88b5a3a9e54b6093ac93437194a76d/users/882cc2aef0db4e0d8a8c066527dab021/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:19.139835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.140268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.140675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.154526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:19.181165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] MFA Rules not processed for user `882cc2aef0db4e0d8a8c066527dab021`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:19.183179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.244369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1051/2091] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:18 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:19.245605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.276844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71c9cc-f090-4d24-9457-c590b00109e5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.337336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1041/2092] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:19.352719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.356007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.391033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.391680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.392059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.392337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.393073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.395702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.410386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1052/2093] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:19.414063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.429958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f8430-8a42-4dd0-9a59-e44a1319abc0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.436599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.437222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.437499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.438523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.439209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.440993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.457699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6cce-b941-4f16-84c7-25cde1a4b1e9 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.458551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1053/2094] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:19.460465 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.463839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.464506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.465297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.465683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.466093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.469239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.487822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732a8d7-b946-4806-a1ff-3608e56c4176 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.493302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.494211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.494996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.494996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] PATH_INFO: `/v3/projects/89b96b52aafe4ad6976ddd858047a184` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.495961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b96b52aafe4ad6976ddd858047a184)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.498083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.531669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:19.550603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.553742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.569397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1042/2095] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:19.569397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.585717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa22fc-f891-4a19-be11-e07e8f041096 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:19.591364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03c8e0-9870-49eb-a125-de6e2ea08afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:19.592641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c8e0-9870-49eb-a125-de6e2ea08afa admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.598103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c8e0-9870-49eb-a125-de6e2ea08afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.598103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03c8e0-9870-49eb-a125-de6e2ea08afa admin admin] PATH_INFO: `/v3/projects/3ee4660de33a47249e587fec0e02a984/users/71e2e5531e714b6bacb620eb03206fa4/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.612266 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c8e0-9870-49eb-a125-de6e2ea08afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee4660de33a47249e587fec0e02a984, user_id=71e2e5531e714b6bacb620eb03206fa4, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:19.615270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03c8e0-9870-49eb-a125-de6e2ea08afa admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:19.745181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1043/2096] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:19 2022] PUT /identity/v3/projects/3ee4660de33a47249e587fec0e02a984/users/71e2e5531e714b6bacb620eb03206fa4/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:19.752259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b96b52aafe4ad6976ddd858047a184', 'request_id': 'req-40dc4158-fde2-4377-9122-8995fcba3d6f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.755378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.755378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.755703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.767294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b96b52aafe4ad6976ddd858047a184', 'request_id': 'req-40dc4158-fde2-4377-9122-8995fcba3d6f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.801745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] MFA Rules not processed for user `71e2e5531e714b6bacb620eb03206fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:19.804052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:19.862528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b96b52aafe4ad6976ddd858047a184', 'request_id': 'req-40dc4158-fde2-4377-9122-8995fcba3d6f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.886413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] The token cache is being invalidate because project 89b96b52aafe4ad6976ddd858047a184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:19.887223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.888807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-40dc4158-fde2-4377-9122-8995fcba3d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:19.905903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1054/2097] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:19 2022] DELETE /identity/v3/projects/89b96b52aafe4ad6976ddd858047a184 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:19.909821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb350e-7042-4ecf-87cb-e87cc8d7139c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:19.910104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb350e-7042-4ecf-87cb-e87cc8d7139c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:19.910377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb350e-7042-4ecf-87cb-e87cc8d7139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:19.919392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1044/2098] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:19.930647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:19.944515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0fdb350e-7042-4ecf-87cb-e87cc8d7139c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:19.946144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0fdb350e-7042-4ecf-87cb-e87cc8d7139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.036626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71becd-9778-43a6-80ed-9fe35fd84806 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.040636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.041296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.041629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.042536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.044121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.055599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1055/2099] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.059663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.061557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.063410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.064057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.064512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.081309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1045/2100] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:49:20.089409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:20.092898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.107904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1056/2101] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.112206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.125220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede2cc9-5b72-4e2f-87af-8b6d707732ca service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.130742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.131478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.131940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.132304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.134624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:20.138262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.140425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.165183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1046/2102] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:20.168653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.179435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567606ef-d150-4ce8-8d00-51cb7f83bda2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.198365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f91a-7946-4647-bc84-c28dd6459201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.199344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f91a-7946-4647-bc84-c28dd6459201 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.199734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f91a-7946-4647-bc84-c28dd6459201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.200169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f91a-7946-4647-bc84-c28dd6459201 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.201096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f91a-7946-4647-bc84-c28dd6459201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.204825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7617f91a-7946-4647-bc84-c28dd6459201 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.386527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1057/2103] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:20.390861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.404917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529acac-f60f-424d-91d0-35cb4d623442 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.502332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f0a3-4246-4cc4-b9ea-e7c23a9caaea None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.502611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f0a3-4246-4cc4-b9ea-e7c23a9caaea None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.503106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702f0a3-4246-4cc4-b9ea-e7c23a9caaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.525134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.526406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.526853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.527284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.528074 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.530439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.556933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9702f0a3-4246-4cc4-b9ea-e7c23a9caaea None None] MFA Rules not processed for user `dd8808dab1914b269a80addf376bab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:20.558360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9702f0a3-4246-4cc4-b9ea-e7c23a9caaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.621699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1047/2104] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:20.622650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.665814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d91a-ac6a-41b3-99ac-041d6d4ae351 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.681160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.681850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.682143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.682414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.683293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.685176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.714180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1048/2105] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:20.716107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1058/2106] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.729596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.743883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.743883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.743883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.753487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106347d1-8441-4ed5-9e83-cf99faaa0915 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.758199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] MFA Rules not processed for user `dd8808dab1914b269a80addf376bab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:20.761290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.763801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.765023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.765547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.765974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.766763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.768585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.780400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1049/2107] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:20.780890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1059/2108] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:20.793194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.794624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:20.794748 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:20.805880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ee7bc-bf7a-4163-a8d0-318ba3d9bd78 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.811844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdab14-4b7b-43b6-a009-c3708311f657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.812534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdab14-4b7b-43b6-a009-c3708311f657 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.812873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdab14-4b7b-43b6-a009-c3708311f657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.813161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdab14-4b7b-43b6-a009-c3708311f657 admin admin] PATH_INFO: `/v3/projects/9522316ae2c4493dbe230536555c50f3/users/993f6b61ef364e36991ba2606d3b750c/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.829536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdab14-4b7b-43b6-a009-c3708311f657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9522316ae2c4493dbe230536555c50f3, user_id=993f6b61ef364e36991ba2606d3b750c, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.832556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbdab14-4b7b-43b6-a009-c3708311f657 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.882361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8ec59e-be05-4ebe-a55c-86fd89565b62 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:20.889430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:20.890322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.890322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.890648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.898935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:20.901007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:20.929491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1050/2109] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:20 2022] PUT /identity/v3/projects/9522316ae2c4493dbe230536555c50f3/users/993f6b61ef364e36991ba2606d3b750c/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:20.949351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:20.949351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:20.949351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:20.949908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1060/2110] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:21.018147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] MFA Rules not processed for user `993f6b61ef364e36991ba2606d3b750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:21.031457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.112716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.118788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1051/2111] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:21.125364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0733e-9d9e-49d7-a8dc-ae21a825eec0 service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.219902 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.220664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.221067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.221626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.222506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.224538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.355072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.361058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1061/2112] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/projects => generated 381 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:21.367139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17eafb-46c5-43cb-8e14-2b4268589890 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.475450 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.478554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.478910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.479265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.480109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.482301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.562377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1052/2113] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:21.565023 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.578556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:21.581712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac09158-b78f-41e1-8cd6-5685bc5e7ca8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.589421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.590138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.590421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.590693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.591399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.593677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.604941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1062/2114] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:21.609267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.620873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485005ec-f7a3-44b3-a0dc-70c83060b7b9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.625873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.626500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.626791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.627070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] PATH_INFO: `/v3/projects/b60081675a614079a10689adccbc6329/users/45030542e6454c5d8dff8a5e32ef4c7c/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.645828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60081675a614079a10689adccbc6329, user_id=45030542e6454c5d8dff8a5e32ef4c7c, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.648521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.716164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1053/2115] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:21 2022] PUT /identity/v3/projects/b60081675a614079a10689adccbc6329/users/45030542e6454c5d8dff8a5e32ef4c7c/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:21.721049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.734829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a3d36-941c-483c-aa22-5cd2870c5e01 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.819839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6dc57-a176-4e32-8a7a-b29428848bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.820592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6dc57-a176-4e32-8a7a-b29428848bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.820882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6dc57-a176-4e32-8a7a-b29428848bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.821226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6dc57-a176-4e32-8a7a-b29428848bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.821917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6dc57-a176-4e32-8a7a-b29428848bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.823524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6dc57-a176-4e32-8a7a-b29428848bdd admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.842675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:21.842868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1063/2116] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:21.857198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01298206-0b88-49fa-bfc0-c0d675a3da6c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:21.859893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3985739e-a45e-4cb3-900c-92f165b3bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:21.860760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985739e-a45e-4cb3-900c-92f165b3bd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.861124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985739e-a45e-4cb3-900c-92f165b3bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.861533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985739e-a45e-4cb3-900c-92f165b3bd9b admin admin] PATH_INFO: `/v3/projects/b60081675a614079a10689adccbc6329/users/45030542e6454c5d8dff8a5e32ef4c7c/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.863622 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985739e-a45e-4cb3-900c-92f165b3bd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60081675a614079a10689adccbc6329, user_id=45030542e6454c5d8dff8a5e32ef4c7c, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:21.866554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3985739e-a45e-4cb3-900c-92f165b3bd9b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:21.893123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1054/2117] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:21 2022] PUT /identity/v3/projects/b60081675a614079a10689adccbc6329/users/45030542e6454c5d8dff8a5e32ef4c7c/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:21.903884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.904171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.904453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.924461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561672-a77a-40ca-b136-6f289002f076 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:21.924754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561672-a77a-40ca-b136-6f289002f076 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:21.925029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58561672-a77a-40ca-b136-6f289002f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:21.949396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] MFA Rules not processed for user `45030542e6454c5d8dff8a5e32ef4c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:21.954598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:21.967764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-58561672-a77a-40ca-b136-6f289002f076 None None] MFA Rules not processed for user `dd8808dab1914b269a80addf376bab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:21.969284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-58561672-a77a-40ca-b136-6f289002f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.051860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1064/2118] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:22.053553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1055/2119] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:22.065291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:22.067434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:22.093142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:22.142379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49b7d0-704a-4721-9da6-d2954e148466 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:22.149690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea85a51-85c3-4dd2-aa4f-6c72ecbe4c68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:22.150487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea85a51-85c3-4dd2-aa4f-6c72ecbe4c68 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:22.151113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea85a51-85c3-4dd2-aa4f-6c72ecbe4c68 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:22.151457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea85a51-85c3-4dd2-aa4f-6c72ecbe4c68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:22.164181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea85a51-85c3-4dd2-aa4f-6c72ecbe4c68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:22.165806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea85a51-85c3-4dd2-aa4f-6c72ecbe4c68 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:22.179121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1065/2120] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:22.886366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561672-a77a-40ca-b136-6f289002f076 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:23.063929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58561672-a77a-40ca-b136-6f289002f076 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.078423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.078698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.078787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.079021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] PATH_INFO: `/v3/users/993f6b61ef364e36991ba2606d3b750c` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.082492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993f6b61ef364e36991ba2606d3b750c)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.084653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.358500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993f6b61ef364e36991ba2606d3b750c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:23.360090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993f6b61ef364e36991ba2606d3b750c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:23.360914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993f6b61ef364e36991ba2606d3b750c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:23.385541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993f6b61ef364e36991ba2606d3b750c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:23.486087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993f6b61ef364e36991ba2606d3b750c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:23.514895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1056/2121] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:22 2022] DELETE /identity/v3/users/993f6b61ef364e36991ba2606d3b750c => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:23.520151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.520643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.520739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.546128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:23.547529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:23.685702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1066/2122] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:23.697925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:23.697925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:23.781854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c2405-ecdd-46b5-92fc-195e14d13959 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:23.785706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:23.786377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:23.786724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:23.787008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:23.803048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:23.804695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:23.834431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1057/2123] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:24.408926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:24.410638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:24.432488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d0321-0abe-499b-a493-fbfb5dfedc99 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:24.438779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:24.439638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:24.439919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:24.440188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] PATH_INFO: `/v3/projects/9522316ae2c4493dbe230536555c50f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:24.441761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9522316ae2c4493dbe230536555c50f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:24.443737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:24.565974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9522316ae2c4493dbe230536555c50f3', 'request_id': 'req-c2c6a5d3-6402-4517-b2b0-32b11f659d73'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.574637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9522316ae2c4493dbe230536555c50f3', 'request_id': 'req-c2c6a5d3-6402-4517-b2b0-32b11f659d73'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.651764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9522316ae2c4493dbe230536555c50f3', 'request_id': 'req-c2c6a5d3-6402-4517-b2b0-32b11f659d73'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.663863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] The token cache is being invalidate because project 9522316ae2c4493dbe230536555c50f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:24.664165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.664884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.666642 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1067/2124] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:24 2022] DELETE /identity/v3/projects/9522316ae2c4493dbe230536555c50f3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:24.670871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:24.680866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82b4d7-d46f-44d6-b98e-b3ce495b96a0 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:24.720769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:24.762253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:24.762998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:24.765169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:24.765169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] PATH_INFO: `/v3/users/45030542e6454c5d8dff8a5e32ef4c7c` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:24.765629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45030542e6454c5d8dff8a5e32ef4c7c)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:24.767614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:24.970190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45030542e6454c5d8dff8a5e32ef4c7c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.970893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45030542e6454c5d8dff8a5e32ef4c7c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.971518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45030542e6454c5d8dff8a5e32ef4c7c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:24.986487 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45030542e6454c5d8dff8a5e32ef4c7c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.046316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f2ebcb09-d40c-4d9b-9a44-be18feb8252e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45030542e6454c5d8dff8a5e32ef4c7c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.060599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1058/2125] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:24 2022] DELETE /identity/v3/users/45030542e6454c5d8dff8a5e32ef4c7c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:25.384843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:25.607384 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.609516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:25.624385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6a5d3-6402-4517-b2b0-32b11f659d73 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:25.686876 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:25.687527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.687811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.688088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] PATH_INFO: `/v3/projects/b60081675a614079a10689adccbc6329` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.689347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60081675a614079a10689adccbc6329)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:25.691419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:25.817280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60081675a614079a10689adccbc6329', 'request_id': 'req-cc4807c1-e396-4ac2-a055-e2d657e48efb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.823425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60081675a614079a10689adccbc6329', 'request_id': 'req-cc4807c1-e396-4ac2-a055-e2d657e48efb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.908556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60081675a614079a10689adccbc6329', 'request_id': 'req-cc4807c1-e396-4ac2-a055-e2d657e48efb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.919456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] The token cache is being invalidate because project b60081675a614079a10689adccbc6329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:25.919746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.920400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:25.921953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1068/2126] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:25 2022] DELETE /identity/v3/projects/b60081675a614079a10689adccbc6329 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:25.927095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48be6ae-a740-49ad-bb6b-f31d0739133a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:25.927695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48be6ae-a740-49ad-bb6b-f31d0739133a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:25.927695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48be6ae-a740-49ad-bb6b-f31d0739133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:25.947530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b48be6ae-a740-49ad-bb6b-f31d0739133a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:25.948758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b48be6ae-a740-49ad-bb6b-f31d0739133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:25.953053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:25.954837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.017635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1059/2127] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:26.025632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.029017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.029017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.032657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4807c1-e396-4ac2-a055-e2d657e48efb admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.038810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.039523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.039871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.040226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] PATH_INFO: `/v3/users/71e2e5531e714b6bacb620eb03206fa4` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.042043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e2e5531e714b6bacb620eb03206fa4)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.044544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.047483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:26.048865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.076585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1060/2128] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:26.081363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.099368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cdeb7-6e53-4ef2-9291-905b1ff182b1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.099368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.099815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.100171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.100513 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.101402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:26.101810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.103527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.119587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1061/2129] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:26.127928 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.146716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c7042-0550-4186-b3c0-f420fd152f01 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.154031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.154687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.156490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.156490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.156917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.159440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.265839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1062/2130] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:26 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:26.269880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.272272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e2e5531e714b6bacb620eb03206fa4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.273051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e2e5531e714b6bacb620eb03206fa4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.273726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e2e5531e714b6bacb620eb03206fa4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.286565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e2e5531e714b6bacb620eb03206fa4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.332727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba3f6e-fd2a-4b5b-b95b-ef49d5681df3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.337331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.337968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.338249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.338538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.339236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.341136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.366215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-29740473-f60a-47af-bce6-2fff0f7f1bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e2e5531e714b6bacb620eb03206fa4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:26.384408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1069/2131] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:25 2022] DELETE /identity/v3/users/71e2e5531e714b6bacb620eb03206fa4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:26.393661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.393985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.395038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.415906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:26.417333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.445745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1063/2132] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:26 2022] POST /identity/v3/users => generated 286 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:26.447002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.449730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.484808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3e000-7c9d-4e3e-8626-0053f30ae866 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.520661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1070/2133] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:26.536809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.540376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.578948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.579656 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.579907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.580181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.581230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.582909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.594827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1064/2134] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:26.598834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.609264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa8e80-f6cb-4045-8d57-96ed82b1ee78 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.611782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acceb08-8458-4d4c-98d6-33a240e227b2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.615506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.616261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.616553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.616819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.617492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.618938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceac68a-9077-4f9b-926f-a2d0ed216ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.619188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.619559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac68a-9077-4f9b-926f-a2d0ed216ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.619840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac68a-9077-4f9b-926f-a2d0ed216ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.620113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceac68a-9077-4f9b-926f-a2d0ed216ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.630178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceac68a-9077-4f9b-926f-a2d0ed216ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.631503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1065/2135] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:49:26.632040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceac68a-9077-4f9b-926f-a2d0ed216ac3 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.635736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.643293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1071/2136] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:26.646914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b1f3b-9411-4f6d-80e4-d02ebbdfd08d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:26.652115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:26.652783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.653065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.653342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] PATH_INFO: `/v3/projects/b217967cdb4a4dcfafdb3e670efedcfc/users/5963d42a32fb4a81af37eb42ad14993e/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.669906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b217967cdb4a4dcfafdb3e670efedcfc, user_id=5963d42a32fb4a81af37eb42ad14993e, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:26.673343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:26.752349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1066/2137] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:26 2022] PUT /identity/v3/projects/b217967cdb4a4dcfafdb3e670efedcfc/users/5963d42a32fb4a81af37eb42ad14993e/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:26.757688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:26.758009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:26.758700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:26.783936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:26.785896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:26.866980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1072/2138] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:26.906291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:26.960806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:27.009263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a663d-f3b7-41e5-af50-464e11e89e50 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:27.013717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055e4d1-83b7-4500-a4a0-8feb4206ca40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:27.014391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e4d1-83b7-4500-a4a0-8feb4206ca40 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.014876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e4d1-83b7-4500-a4a0-8feb4206ca40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.017293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055e4d1-83b7-4500-a4a0-8feb4206ca40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.032254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055e4d1-83b7-4500-a4a0-8feb4206ca40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:27.034077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055e4d1-83b7-4500-a4a0-8feb4206ca40 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:27.047507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1067/2139] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:27.300544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:27.302140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:27.334304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc247d-b5ed-49eb-8c3b-ada722521727 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:27.348787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:27.349676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.350353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.350782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] PATH_INFO: `/v3/projects/3ee4660de33a47249e587fec0e02a984` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.352159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee4660de33a47249e587fec0e02a984)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:27.354849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:27.554427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee4660de33a47249e587fec0e02a984', 'request_id': 'req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.563775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee4660de33a47249e587fec0e02a984', 'request_id': 'req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.572151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:27.641638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee4660de33a47249e587fec0e02a984', 'request_id': 'req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.658462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] The token cache is being invalidate because project 3ee4660de33a47249e587fec0e02a984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:27.658993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.659816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4065d3b9-c917-4c8f-9dc9-a20b84e9a479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:27.666670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1073/2140] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:27 2022] DELETE /identity/v3/projects/3ee4660de33a47249e587fec0e02a984 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:27.669428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.669718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.670091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.694529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:27.695782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:27.757371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1068/2141] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:27.767045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.767330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.767607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.799584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:27.799584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:27.806765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1074/2142] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:27.807679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:27.823134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd118cc-425b-4c87-9a5b-28f9248d6a4f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:27.841833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:27.842710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.843073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.843286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.843972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:27.844379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:27.846416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:27.859964 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1069/2143] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:27.864438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:27.876891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5be1e1-18b0-4232-9206-7c4b22058efd None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:27.884817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:27.886251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:27.886978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:27.887899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:27.889115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:27.891966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.008330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1075/2144] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:27 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:28.009433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.020317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d5341f-9514-4a4b-918e-053992ad1c0a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.080363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.080981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.081257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.081530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.082209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.084149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.247822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1070/2145] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:28 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:28.252303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.264213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24253e4a-86a0-40a2-9cb0-30b55bcd751f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.269077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.269844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.270199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.270699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.271433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.273301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.289008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1076/2146] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:28.291172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.304079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40686bec-027c-4fc8-a6db-1d6213cf102c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.309730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45b446-ae06-4167-92df-b089b3716da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.310555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45b446-ae06-4167-92df-b089b3716da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.310977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45b446-ae06-4167-92df-b089b3716da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.311365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45b446-ae06-4167-92df-b089b3716da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.313057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45b446-ae06-4167-92df-b089b3716da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.315093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45b446-ae06-4167-92df-b089b3716da4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.331842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1071/2147] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:28.333162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.345494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf69163-085f-4921-afdd-392072a4f36a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.352081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.358244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.358244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.358244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] PATH_INFO: `/v3/projects/39cad8ee39f94c6c86ea2b917e07303d/users/3cea099c504747b79569502060146e36/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.378393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39cad8ee39f94c6c86ea2b917e07303d, user_id=3cea099c504747b79569502060146e36, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.381927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.513965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1077/2148] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:28 2022] PUT /identity/v3/projects/39cad8ee39f94c6c86ea2b917e07303d/users/3cea099c504747b79569502060146e36/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:28.516175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.516500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.516867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.547961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] MFA Rules not processed for user `3cea099c504747b79569502060146e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:28.549364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:28.642838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1072/2149] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:28.666789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:28.669532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:28.780067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d85731-e37e-4cb4-bc77-fa3710a26e47 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:28.787847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd5f07-7f38-4c9d-817a-15d1077f2b8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:28.789310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd5f07-7f38-4c9d-817a-15d1077f2b8e service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:28.794556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd5f07-7f38-4c9d-817a-15d1077f2b8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:28.794556 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd5f07-7f38-4c9d-817a-15d1077f2b8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:28.805547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd5f07-7f38-4c9d-817a-15d1077f2b8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:28.808015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd5f07-7f38-4c9d-817a-15d1077f2b8e service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:28.824942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1078/2150] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:28.995666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:29.016248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.018146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:29.037175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fbe3a-d08e-4750-85dd-0e422cecdb0b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.051026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.051865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.052569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.053362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.056381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:29.139783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.141681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.150164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.150626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.151071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.155162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1073/2151] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:29.189365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] MFA Rules not processed for user `5963d42a32fb4a81af37eb42ad14993e`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:29.190624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:29.282134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1079/2152] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:29.283179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.284671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:29.350954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a16f7-72e8-4d6a-973c-3be0ca2c41dc service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.356080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.356639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.356921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.364734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.364734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.364734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.464546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1074/2153] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:29 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:29.469305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.480521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e75d32-9d15-4333-b9e2-9244a9bd6fad None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.537037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.537597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.537981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.538260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.538899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.542044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.658740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1080/2154] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:29 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:29.665449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.676893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a11f49-edc9-4771-a0ab-d5fdc87f1858 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.701132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.701132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.701132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.701132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.702041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.702041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.702041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1075/2155] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:29.704261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.715803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3804-a169-438d-b629-5007fc257ea2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.720662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.721260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.721542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.721846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] PATH_INFO: `/v3/projects/5cc88609df11435e8e9209043c29b70e/users/5d1943652a8749c4bb9e56004e763ad4/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.737987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc88609df11435e8e9209043c29b70e, user_id=5d1943652a8749c4bb9e56004e763ad4, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.740729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.819201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1081/2156] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:29 2022] PUT /identity/v3/projects/5cc88609df11435e8e9209043c29b70e/users/5d1943652a8749c4bb9e56004e763ad4/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:29.830824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.841735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5215f2-5c35-4693-b169-8a46f36790fd admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.898486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b6aab-4c82-4e98-ac6c-ffd7d92f12ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.899137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6aab-4c82-4e98-ac6c-ffd7d92f12ad admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.899373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6aab-4c82-4e98-ac6c-ffd7d92f12ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.899645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b6aab-4c82-4e98-ac6c-ffd7d92f12ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.900289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b6aab-4c82-4e98-ac6c-ffd7d92f12ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.902189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b6aab-4c82-4e98-ac6c-ffd7d92f12ad admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.912290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1076/2157] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:29.916449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:29.927613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd486fe5-4c8f-4824-b0be-daf0b5611c4e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:29.935527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f116339-6715-4520-bb7d-d267d89c8b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:29.936152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f116339-6715-4520-bb7d-d267d89c8b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:29.936626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f116339-6715-4520-bb7d-d267d89c8b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:29.937095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f116339-6715-4520-bb7d-d267d89c8b7c admin admin] PATH_INFO: `/v3/projects/5cc88609df11435e8e9209043c29b70e/users/5d1943652a8749c4bb9e56004e763ad4/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:29.939166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f116339-6715-4520-bb7d-d267d89c8b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cc88609df11435e8e9209043c29b70e, user_id=5d1943652a8749c4bb9e56004e763ad4, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:29.942118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f116339-6715-4520-bb7d-d267d89c8b7c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:29.953851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1082/2158] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:29 2022] PUT /identity/v3/projects/5cc88609df11435e8e9209043c29b70e/users/5d1943652a8749c4bb9e56004e763ad4/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:30.053448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:31.104273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:31.431520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.432121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.432518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.507512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] MFA Rules not processed for user `5d1943652a8749c4bb9e56004e763ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:31.509869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:31.630729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1077/2159] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:31.644640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.645240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.645240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.669709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] MFA Rules not processed for user `5963d42a32fb4a81af37eb42ad14993e`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:31.672564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:31.744261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1083/2160] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:31.763631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:31.765117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:31.865203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ec06d-2d9d-4393-af52-4d04808ace0f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:31.871776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5f30f-11b5-43a6-8ed2-aee8949cd865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:31.872325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f30f-11b5-43a6-8ed2-aee8949cd865 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:31.872620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f30f-11b5-43a6-8ed2-aee8949cd865 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:31.872872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5f30f-11b5-43a6-8ed2-aee8949cd865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:31.881690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f30f-11b5-43a6-8ed2-aee8949cd865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:31.883331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5f30f-11b5-43a6-8ed2-aee8949cd865 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:31.894394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1078/2161] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:32.315169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:33.179892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:33.243287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ba0b0-2651-48ec-8190-1d9fcb6b1bb8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:33.248153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:33.249042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:33.249042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:33.249310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] PATH_INFO: `/v3/users/3cea099c504747b79569502060146e36` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:33.251039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cea099c504747b79569502060146e36)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:33.252983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:33.521086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cea099c504747b79569502060146e36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:33.525413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cea099c504747b79569502060146e36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:33.528728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cea099c504747b79569502060146e36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:33.544146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cea099c504747b79569502060146e36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:33.652498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cea099c504747b79569502060146e36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:33.668282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1084/2162] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:33 2022] DELETE /identity/v3/users/3cea099c504747b79569502060146e36 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:33.673566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:33.674071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:33.674278 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:33.703246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:33.704456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:33.763691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1079/2163] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:33.773653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:33.775221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:33.798132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:33.836532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ba5a1-0122-4c44-a0b2-9a46d34de02b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:33.840523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19f88c-c32a-4359-8c90-83361e1a1db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:33.841129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f88c-c32a-4359-8c90-83361e1a1db5 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:33.841408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f88c-c32a-4359-8c90-83361e1a1db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:33.841678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19f88c-c32a-4359-8c90-83361e1a1db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:33.851955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f88c-c32a-4359-8c90-83361e1a1db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:33.853442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19f88c-c32a-4359-8c90-83361e1a1db5 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:33.864210 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1085/2164] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:34.362810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:34.364505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:34.388845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a61a2-0b5b-416f-b906-ab55f2c9f324 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:34.402653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:34.404930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:34.404930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:34.404930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] PATH_INFO: `/v3/projects/39cad8ee39f94c6c86ea2b917e07303d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:34.406510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39cad8ee39f94c6c86ea2b917e07303d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:34.407639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:34.556877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39cad8ee39f94c6c86ea2b917e07303d', 'request_id': 'req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.564016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39cad8ee39f94c6c86ea2b917e07303d', 'request_id': 'req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.569917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39cad8ee39f94c6c86ea2b917e07303d', 'request_id': 'req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.706647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] The token cache is being invalidate because project 39cad8ee39f94c6c86ea2b917e07303d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:34.707623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.708355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bcd0485a-e0ca-4ed2-a3f7-a024a96302e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:34.710426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1080/2165] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:34 2022] DELETE /identity/v3/projects/39cad8ee39f94c6c86ea2b917e07303d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:34.716022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:34.717374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:34.718043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:34.770402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:34.773922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:34.883333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1086/2166] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:34.883912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:34.884206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:34.884511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:34.928196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:34.929862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:34.945490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1081/2167] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:34.950375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:34.963497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc371206-8479-4cee-9557-1c882ba224ed None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:34.968958 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:34.970099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:34.970478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:34.970777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:34.971444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:34.971756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:34.973356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:34.987322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1087/2168] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:49:34.991918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.002653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4049f3-7063-4684-9d8b-1da1832387eb None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.008043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.008692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.009051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.009330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.010023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.012221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.060941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:35.139515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1082/2169] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:34 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:35.144360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.155374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f52243-016a-405d-ad4e-446203b73bb4 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.212714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.213330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.213609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.213918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.214561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.216570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.298382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1088/2170] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:35 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:35.302540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.313600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5cad0-3e51-4ca3-a06f-2f0b9386fc1d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.318114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.318716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.318991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.319257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.319897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.321471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.335382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1083/2171] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:35.336748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.347207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a01ade-0e19-4df4-a1fe-604fa6264b1a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.352745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252cd0f-42ad-4a4f-a99f-673e81705ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.353378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252cd0f-42ad-4a4f-a99f-673e81705ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.353661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252cd0f-42ad-4a4f-a99f-673e81705ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.353971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252cd0f-42ad-4a4f-a99f-673e81705ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.354623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252cd0f-42ad-4a4f-a99f-673e81705ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.356245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252cd0f-42ad-4a4f-a99f-673e81705ef7 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.367422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1089/2172] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:35.371824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.383016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9453d-879d-462e-b9f3-d8569d580d4c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.388417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.388983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.389268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.394589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] PATH_INFO: `/v3/projects/215eb7dafffe499fad6075b84bc609d3/users/1ad3dce1516c4163af39a94c63679ac5/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.405384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215eb7dafffe499fad6075b84bc609d3, user_id=1ad3dce1516c4163af39a94c63679ac5, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.408113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.516683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1084/2173] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:35 2022] PUT /identity/v3/projects/215eb7dafffe499fad6075b84bc609d3/users/1ad3dce1516c4163af39a94c63679ac5/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:35.522228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.522512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.522785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.541610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:35.542852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:35.591199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:35.606411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1090/2174] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:35.616741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:35.618893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:35.677637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc32690-8cd3-4b97-bdf4-a656fb624298 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:35.681537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db6344-6555-4686-8614-eef7d9ba50d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:35.682189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6344-6555-4686-8614-eef7d9ba50d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:35.682489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6344-6555-4686-8614-eef7d9ba50d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:35.682760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db6344-6555-4686-8614-eef7d9ba50d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:35.692706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db6344-6555-4686-8614-eef7d9ba50d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:35.694181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db6344-6555-4686-8614-eef7d9ba50d1 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:35.703727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1085/2175] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:36.645816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:36.647279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:36.661817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138dfa-1923-4fe3-a83e-094417ee674d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:36.667250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:36.667942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:36.668224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:36.668517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] PATH_INFO: `/v3/users/f418766dfa5941e59c29d47923b10560` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:36.669658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f418766dfa5941e59c29d47923b10560)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:36.671691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:37.043491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f418766dfa5941e59c29d47923b10560'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.045548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f418766dfa5941e59c29d47923b10560'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.046291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f418766dfa5941e59c29d47923b10560'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.059305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f418766dfa5941e59c29d47923b10560'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.169055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f418766dfa5941e59c29d47923b10560'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:37.187911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1091/2176] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:36 2022] DELETE /identity/v3/users/f418766dfa5941e59c29d47923b10560 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:37.190548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1860-dbef-4531-b0bc-e2229734219d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:37.191006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1860-dbef-4531-b0bc-e2229734219d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:37.191337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1860-dbef-4531-b0bc-e2229734219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:37.221847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0d8b1860-dbef-4531-b0bc-e2229734219d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:37.224208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0d8b1860-dbef-4531-b0bc-e2229734219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:37.325825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1086/2177] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:37.339477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:37.341590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:37.352677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:37.355652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:37.355652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:37.392617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] MFA Rules not processed for user `1ad3dce1516c4163af39a94c63679ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:37.394600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:37.413517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d2a9-ed84-41e8-99c9-045f7b4bf206 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:37.418650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:37.419543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:37.419964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:37.420407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:37.434464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:37.436110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:37.454062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1092/2178] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:37.477754 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1087/2179] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:37.489862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:37.491343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:37.565481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4be5a-7065-4122-bb27-d9ff267327b3 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:37.569318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:37.570087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:37.570443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:37.570778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:37.580239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:37.581676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:37.593063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1093/2180] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:37.917912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:37.922104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:37.934958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529c6b-ac15-4bc4-a4f9-3234e1d89bc8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:37.939633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:37.940275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:37.940556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:37.940831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] PATH_INFO: `/v3/projects/73ad45512195494b897b7ebf01db3ab6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:37.942082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ad45512195494b897b7ebf01db3ab6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:37.943921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:38.053106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ad45512195494b897b7ebf01db3ab6', 'request_id': 'req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.059435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ad45512195494b897b7ebf01db3ab6', 'request_id': 'req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.065083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ad45512195494b897b7ebf01db3ab6', 'request_id': 'req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.155793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] The token cache is being invalidate because project 73ad45512195494b897b7ebf01db3ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:38.156699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.157465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.159182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1088/2181] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:37 2022] DELETE /identity/v3/projects/73ad45512195494b897b7ebf01db3ab6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:38.163307 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:38.174414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2bb4-c0c4-4c05-9969-bffbb5f40ec8 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:38.233759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:38.234428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:38.234713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:38.235094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] PATH_INFO: `/v3/users/882cc2aef0db4e0d8a8c066527dab021` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:38.236363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=882cc2aef0db4e0d8a8c066527dab021)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:38.238303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:38.289981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:38.496374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882cc2aef0db4e0d8a8c066527dab021'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.497035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882cc2aef0db4e0d8a8c066527dab021'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.497639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882cc2aef0db4e0d8a8c066527dab021'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.513810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882cc2aef0db4e0d8a8c066527dab021'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.635327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4db72841-6286-4ee0-8ec3-34ae66125f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882cc2aef0db4e0d8a8c066527dab021'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:38.649514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1094/2182] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:49:38 2022] DELETE /identity/v3/users/882cc2aef0db4e0d8a8c066527dab021 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:49:38.658632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:39.156581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:39.158174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:39.174610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c7a6d-d792-48eb-84bf-7117ddfcf95c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:39.253194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:39.254077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:39.254924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:39.255323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] PATH_INFO: `/v3/projects/9f88b5a3a9e54b6093ac93437194a76d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:39.257605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f88b5a3a9e54b6093ac93437194a76d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:39.259777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:39.422531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f88b5a3a9e54b6093ac93437194a76d', 'request_id': 'req-9852739c-bca8-4986-80e9-88bfb40edf02'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:39.429937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f88b5a3a9e54b6093ac93437194a76d', 'request_id': 'req-9852739c-bca8-4986-80e9-88bfb40edf02'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:39.435757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f88b5a3a9e54b6093ac93437194a76d', 'request_id': 'req-9852739c-bca8-4986-80e9-88bfb40edf02'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:39.535109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373034c-88a7-4d03-ac72-3c03d2804482 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:39.535672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373034c-88a7-4d03-ac72-3c03d2804482 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:39.535799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373034c-88a7-4d03-ac72-3c03d2804482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:39.561846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8373034c-88a7-4d03-ac72-3c03d2804482 None None] MFA Rules not processed for user `3589f2353d224fea87a654dd098b69a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:39.563757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8373034c-88a7-4d03-ac72-3c03d2804482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:39.569147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] The token cache is being invalidate because project 9f88b5a3a9e54b6093ac93437194a76d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:49:39.569464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:39.570135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9852739c-bca8-4986-80e9-88bfb40edf02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:49:39.571882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1089/2183] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:49:39 2022] DELETE /identity/v3/projects/9f88b5a3a9e54b6093ac93437194a76d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:39.577712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:39.578174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:39.578458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:39.622105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:39.623332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:39.629147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1095/2184] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:39.715969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1090/2185] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:49:39.724519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:39.724809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:39.725085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:39.752276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:39.753681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:39.763688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1096/2186] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:39.768055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:39.779641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee0fba-289e-4aa0-9585-f0e10febdbe8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:39.785999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:39.786763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:39.787563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:39.787563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:39.788437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:49:39.788805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:39.790714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:39.805402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1091/2187] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:49:39.809736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:39.819879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057424ae-5383-49e6-aacd-3aea65730be3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:39.825414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:39.826702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:39.826702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:39.827765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:39.827765 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:39.830712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:39.943553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1097/2188] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:49:39 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:49:39.944744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:39.955232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d86d5f-ef32-4f18-9aa6-7d3ad3a71bb6 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:40.013974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:40.014808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.017059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.017059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.017059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:40.017915 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:40.129149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1092/2189] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:49:39 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:49:40.137249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:40.145225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07990eed-29b1-4ce7-95af-2263a0f2d0ed admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:40.151616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:40.152669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.152913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.153185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.153880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:40.155676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:40.169156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1098/2190] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:40.173197 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:40.186228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0c409-3273-4246-ad49-70d18af122b8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:40.192337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eed451-5aa7-4a10-ad6a-70230d03cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:40.193000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eed451-5aa7-4a10-ad6a-70230d03cbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.193281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eed451-5aa7-4a10-ad6a-70230d03cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.193555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eed451-5aa7-4a10-ad6a-70230d03cbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.194293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eed451-5aa7-4a10-ad6a-70230d03cbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:40.195970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eed451-5aa7-4a10-ad6a-70230d03cbd4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:40.207829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1093/2191] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:49:40.212124 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:40.223078 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd73dc2-6684-4e49-9d52-990953a9624a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:40.228150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:40.228988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.229273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.229554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] PATH_INFO: `/v3/projects/6d343a86e3164c9bb3d8b187e3d2ad02/users/e38637acec9847b284cf8ba5f9fbd94a/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.245231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d343a86e3164c9bb3d8b187e3d2ad02, user_id=e38637acec9847b284cf8ba5f9fbd94a, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:40.248136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:40.345917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1099/2192] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:49:40 2022] PUT /identity/v3/projects/6d343a86e3164c9bb3d8b187e3d2ad02/users/e38637acec9847b284cf8ba5f9fbd94a/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:49:40.363373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645146-97fa-4e25-b936-e1a87a5efc3c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.363667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645146-97fa-4e25-b936-e1a87a5efc3c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.363945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c645146-97fa-4e25-b936-e1a87a5efc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.435219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0c645146-97fa-4e25-b936-e1a87a5efc3c None None] MFA Rules not processed for user `e38637acec9847b284cf8ba5f9fbd94a`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:40.436355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:40.436811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0c645146-97fa-4e25-b936-e1a87a5efc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:40.525688 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1094/2193] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:40.537514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:40.539564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:40.599377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786617dc-e73e-4f6f-b2b0-fcd05f9d17cf admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:40.603331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:40.603868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.604151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.604437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.617500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:40.619000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:40.629443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1100/2194] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:49:40.698435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:40.698727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:40.699003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:40.719419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] MFA Rules not processed for user `1ad3dce1516c4163af39a94c63679ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:49:40.720648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:40.791704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1095/2195] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:49:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:49:41.167529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:42.945466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:43.127963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:INSERT=8,keystone:DELETE=3,keystone:SELECT=89 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:43.505253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:43.956715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:44.224709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:44.282050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:44.544298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:44.865333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.144465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.283145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.442375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.573752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.722638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.924669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:45.973177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.145466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.179643 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.676123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.773700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:46.979751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.396877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.562657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.699685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:47.765696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.089707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.136720 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.535003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:48.563709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:49.048872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:49.164023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:49.718172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:50.060064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:50.499824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:50.815238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:51.082712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:51.614027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:51.786074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.175287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.311509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.660058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:52.774294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.030981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.231967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.374636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.655145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:53.825995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.141073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.193354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.310932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.337197 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.631887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:54.689149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.391896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.510756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.597177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.780942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.848722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:55.916512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:57.763483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:49:57.764971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:57.771706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:49:57.826245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd184f-9b2b-41b0-b5c5-2aadcd075b21 service glance] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:49:57.829962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:49:57.830595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:49:57.830874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:49:57.831149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:49:57.832962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:49:57.896446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:49:57.897937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c72f56-33f5-43f7-93e4-b024f9caeedf service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:49:57.908226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1101/2196] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:49:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:04.630016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:04.698297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761ff62-e672-4d1a-a811-0dd273076323 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:04.703270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:04.704049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:04.704436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:04.705005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] PATH_INFO: `/v3/users/e38637acec9847b284cf8ba5f9fbd94a` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:04.706292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38637acec9847b284cf8ba5f9fbd94a)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:04.708386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:04.885811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38637acec9847b284cf8ba5f9fbd94a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:04.886406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38637acec9847b284cf8ba5f9fbd94a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:04.887028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38637acec9847b284cf8ba5f9fbd94a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:04.899621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38637acec9847b284cf8ba5f9fbd94a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:04.974163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38637acec9847b284cf8ba5f9fbd94a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:04.982550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:04.987552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1096/2197] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:04 2022] DELETE /identity/v3/users/e38637acec9847b284cf8ba5f9fbd94a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:04.992604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:04.997837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:04.997837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:05.012978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:05.014770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:05.084941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1102/2198] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:05.096131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:05.097546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:05.184623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c41783-919c-4967-884c-c63a58bf5ece admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:05.188446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd3e9e-530c-4db0-8295-c8ea6023ec28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:05.189199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3e9e-530c-4db0-8295-c8ea6023ec28 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:05.189488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3e9e-530c-4db0-8295-c8ea6023ec28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:05.189804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd3e9e-530c-4db0-8295-c8ea6023ec28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:05.200125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd3e9e-530c-4db0-8295-c8ea6023ec28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:05.201568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd3e9e-530c-4db0-8295-c8ea6023ec28 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:05.211598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1097/2199] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:05.731915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:05.733482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:05.745555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a3251-02dd-45cb-9a53-492a675de622 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:05.750352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:05.750995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:05.751275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:05.751547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] PATH_INFO: `/v3/projects/6d343a86e3164c9bb3d8b187e3d2ad02` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:05.752673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d343a86e3164c9bb3d8b187e3d2ad02)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:05.754617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:05.847740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d343a86e3164c9bb3d8b187e3d2ad02', 'request_id': 'req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:05.849012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:05.854788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d343a86e3164c9bb3d8b187e3d2ad02', 'request_id': 'req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:05.924161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d343a86e3164c9bb3d8b187e3d2ad02', 'request_id': 'req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:05.935778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] The token cache is being invalidate because project 6d343a86e3164c9bb3d8b187e3d2ad02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:05.936210 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:05.936886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7cdd15c1-ea51-4e8b-bdc7-2e745c99e8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:05.938613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1103/2200] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:05 2022] DELETE /identity/v3/projects/6d343a86e3164c9bb3d8b187e3d2ad02 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:05.943512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:05.943988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:05.944079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:05.964726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:05.965985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:06.034845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1098/2201] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:06.038899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.039367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.039464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.059935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:06.061516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:06.069683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1104/2202] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:06.074510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.084784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab2351-ebe3-4eb3-ad01-cb68ef84736c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.090378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.091003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.091287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.091565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.092232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:06.092540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.094281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.111375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1099/2203] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:06.112688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.122437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c54dd-76ec-476e-8298-11172beba4a3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.127197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.127816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.128092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.128362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.129082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.131032 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.217695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1105/2204] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:06 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:06.222020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.232778 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d924223-7cab-40f7-9c38-f7425705722d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.298534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.299070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.299354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.299721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.300381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.302494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.413585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1100/2205] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:06 2022] POST /identity/v3/users => generated 283 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:06.415370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.425660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b7a2d-94e7-403f-b9ea-944cd339052d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.431606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.432218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.432500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.432772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.433424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.435038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.446017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1106/2206] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:06.450188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.460681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc3bc5-853f-416a-80bd-fbe4ba068ea8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.467064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785af3ec-847b-491f-aeaf-d5867b318ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.467533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af3ec-847b-491f-aeaf-d5867b318ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.467907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af3ec-847b-491f-aeaf-d5867b318ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.468284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785af3ec-847b-491f-aeaf-d5867b318ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.469518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af3ec-847b-491f-aeaf-d5867b318ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.471568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785af3ec-847b-491f-aeaf-d5867b318ab2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.485954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1101/2207] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:50:06.490449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.515363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c8ce3-c921-4c57-aa64-22fd59f2bd6b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.515363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.515363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.515363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.516947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] PATH_INFO: `/v3/projects/3eb4ef9fd91d4c588bfa89b157d69dc2/users/04ab6ea1e64f4a26856b0bc59fc7553f/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.531649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb4ef9fd91d4c588bfa89b157d69dc2, user_id=04ab6ea1e64f4a26856b0bc59fc7553f, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.534371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.616696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1107/2208] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:06 2022] PUT /identity/v3/projects/3eb4ef9fd91d4c588bfa89b157d69dc2/users/04ab6ea1e64f4a26856b0bc59fc7553f/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:06.628360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0754fb-522c-4b05-97c7-da8a3e300c2b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.628699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0754fb-522c-4b05-97c7-da8a3e300c2b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.628969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0754fb-522c-4b05-97c7-da8a3e300c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.643511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:06.662710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9e0754fb-522c-4b05-97c7-da8a3e300c2b None None] MFA Rules not processed for user `04ab6ea1e64f4a26856b0bc59fc7553f`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:06.664571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9e0754fb-522c-4b05-97c7-da8a3e300c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:06.763013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1102/2209] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:06.775798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:06.778994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:06.849326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3569f6-1850-4562-8cf1-8f40839e7a39 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:06.854142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:06.854752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:06.855056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:06.855328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:06.865009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:06.866744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:06.876882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1108/2210] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:16.781485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=29 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:16.872635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=59,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:17.802222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109ae08-b5e2-469a-b83f-b26147b7e12e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:17.802723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109ae08-b5e2-469a-b83f-b26147b7e12e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:17.802830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109ae08-b5e2-469a-b83f-b26147b7e12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:17.826518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6109ae08-b5e2-469a-b83f-b26147b7e12e None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:17.827704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6109ae08-b5e2-469a-b83f-b26147b7e12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:17.902031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1103/2211] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:50:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:17.950145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:17.951620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:18.034266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfee6d5-f4e1-4656-9a9a-22b2094c8ee2 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:18.040424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85837569-d546-4278-854e-0c8dc279fc22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:18.041038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837569-d546-4278-854e-0c8dc279fc22 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:18.041320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837569-d546-4278-854e-0c8dc279fc22 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:18.041600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837569-d546-4278-854e-0c8dc279fc22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:18.055072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837569-d546-4278-854e-0c8dc279fc22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:18.057308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85837569-d546-4278-854e-0c8dc279fc22 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:18.066447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1109/2212] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:27.886900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=25 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:28.063047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=32 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:36.206442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb61d5-ba24-4376-899f-5ae17e954530 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:36.207031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb61d5-ba24-4376-899f-5ae17e954530 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:36.211357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb61d5-ba24-4376-899f-5ae17e954530 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:36.215697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1104/2213] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:50:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:50:36.222669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:36.222669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:36.223286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:36.257865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] MFA Rules not processed for user `411e88250df044a993d8eb39d988390b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:36.259084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:36.335577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1110/2214] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:50:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:36.344557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb61d5-ba24-4376-899f-5ae17e954530 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:36.351318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5ecb61d5-ba24-4376-899f-5ae17e954530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:36.407436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb61d5-ba24-4376-899f-5ae17e954530 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:36.437087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:36.437829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:36.438103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:36.442314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:36.475183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:36.477780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:36.480677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:36.497056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:36.498710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1105/2215] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:36.632359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fded0-dadb-4fe0-bbff-27400b77df85 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:36.637019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:36.637669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:36.637974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:36.638253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] PATH_INFO: `/v3/users/5963d42a32fb4a81af37eb42ad14993e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:36.639606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5963d42a32fb4a81af37eb42ad14993e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:36.642143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:36.885031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5963d42a32fb4a81af37eb42ad14993e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.886086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5963d42a32fb4a81af37eb42ad14993e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.887035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5963d42a32fb4a81af37eb42ad14993e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:36.902623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5963d42a32fb4a81af37eb42ad14993e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.018463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5963d42a32fb4a81af37eb42ad14993e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.033896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1111/2216] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:36 2022] DELETE /identity/v3/users/5963d42a32fb4a81af37eb42ad14993e => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:37.397589 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:37.432153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bdaf1-185c-406b-a0ff-e00ef0fb8fab service placement] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:37.546290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:37.547290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:37.548212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:37.548212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] PATH_INFO: `/v3/projects/b217967cdb4a4dcfafdb3e670efedcfc` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:37.549616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b217967cdb4a4dcfafdb3e670efedcfc)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:37.551703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:37.686442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b217967cdb4a4dcfafdb3e670efedcfc', 'request_id': 'req-22786f61-c3df-4400-bc2c-ce4c28ec5585'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.694575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b217967cdb4a4dcfafdb3e670efedcfc', 'request_id': 'req-22786f61-c3df-4400-bc2c-ce4c28ec5585'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.700857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b217967cdb4a4dcfafdb3e670efedcfc', 'request_id': 'req-22786f61-c3df-4400-bc2c-ce4c28ec5585'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.801306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] The token cache is being invalidate because project b217967cdb4a4dcfafdb3e670efedcfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:37.801593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.802271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:37.804005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1106/2217] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:37 2022] DELETE /identity/v3/projects/b217967cdb4a4dcfafdb3e670efedcfc => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:50:37.808030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:37.809507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:37.828059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248a8b9-617c-4194-933d-a0533697d8cc admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:37.841162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:37.890781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:37.891860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:37.892138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:37.892411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] PATH_INFO: `/v3/users/5d1943652a8749c4bb9e56004e763ad4` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:37.893557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1943652a8749c4bb9e56004e763ad4)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:37.895535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.121323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1943652a8749c4bb9e56004e763ad4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.122056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1943652a8749c4bb9e56004e763ad4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.122683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1943652a8749c4bb9e56004e763ad4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.134767 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1943652a8749c4bb9e56004e763ad4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.235610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8528565e-a97b-4c4a-a56c-59517b8d3201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1943652a8749c4bb9e56004e763ad4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.251194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1112/2218] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:37 2022] DELETE /identity/v3/users/5d1943652a8749c4bb9e56004e763ad4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:38.540492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:38.542397 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:38.558694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786f61-c3df-4400-bc2c-ce4c28ec5585 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:38.635967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:38.636699 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.637101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.637413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] PATH_INFO: `/v3/projects/5cc88609df11435e8e9209043c29b70e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.638776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cc88609df11435e8e9209043c29b70e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:38.642098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:38.668023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:38.803484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc88609df11435e8e9209043c29b70e', 'request_id': 'req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.809698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc88609df11435e8e9209043c29b70e', 'request_id': 'req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.817297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc88609df11435e8e9209043c29b70e', 'request_id': 'req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.953021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] The token cache is being invalidate because project 5cc88609df11435e8e9209043c29b70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:38.953318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.958709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-bc4299a4-cb4f-4c03-bf92-beec92e2fbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:38.958709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1107/2219] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:38 2022] DELETE /identity/v3/projects/5cc88609df11435e8e9209043c29b70e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:38.961082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:38.961545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:38.961639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:38.983051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:38.984400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:39.051891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1113/2220] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:39.060888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.060888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.060888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.091373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:39.092991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:39.102100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1108/2221] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:39.106559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.116762 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db270d-1b54-45f7-9852-97a0c35b82bd None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.121860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.122467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.122748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.123025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.123672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:39.123977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.126133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.140242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1114/2222] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:39.146310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.158543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c9738-2633-4adf-8d17-7b2f8e0913aa None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.164441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.165493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.165949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.166226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.167211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.170082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.257111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1109/2223] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:39.261479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.272987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24395c-c854-4693-b132-ccb64e734c08 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.296503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:39.344301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.344971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.345476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.345818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.346579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.348795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.429733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1115/2224] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:39.432881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.445750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b85b41-e343-44b1-b07b-1f3b86b91ba8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.456893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.456893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.456893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.456893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.457448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.457448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.469182 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1110/2225] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:39.474070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.501948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2928ec-b01b-41c9-bc46-08d8e0f9af1a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.508857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2684f5-7508-4aa2-82ec-44686649521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.509798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2684f5-7508-4aa2-82ec-44686649521c admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.510480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2684f5-7508-4aa2-82ec-44686649521c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.510977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2684f5-7508-4aa2-82ec-44686649521c admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.512640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2684f5-7508-4aa2-82ec-44686649521c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.515462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2684f5-7508-4aa2-82ec-44686649521c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.534340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1116/2226] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:39.544255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.566685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d40c2-4e2f-4cb5-8a32-6f420461d644 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.573709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.574669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.575022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.575488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] PATH_INFO: `/v3/projects/2ec345705ae3468184619da13f19ac43/users/7de66aab13cb4ea0b756cc6e318b07e4/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.595772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec345705ae3468184619da13f19ac43, user_id=7de66aab13cb4ea0b756cc6e318b07e4, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.598923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.709459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1111/2227] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:39 2022] PUT /identity/v3/projects/2ec345705ae3468184619da13f19ac43/users/7de66aab13cb4ea0b756cc6e318b07e4/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:39.717943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.718433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.718763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.764833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] MFA Rules not processed for user `7de66aab13cb4ea0b756cc6e318b07e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:39.766388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:39.846734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1117/2228] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:39.857982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:39.859702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:39.919865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb57f-dc98-43ce-b25a-23e77f399cc4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:39.924186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20df066-059e-484b-b4ec-0604d32195f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:39.924802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df066-059e-484b-b4ec-0604d32195f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:39.925080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df066-059e-484b-b4ec-0604d32195f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:39.925352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20df066-059e-484b-b4ec-0604d32195f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:39.936616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df066-059e-484b-b4ec-0604d32195f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:39.944545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20df066-059e-484b-b4ec-0604d32195f3 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:39.948564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1112/2229] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:39.971062 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:40.039321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8fad-4336-469c-81d8-a42163bbb3e0 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:40.044072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:40.044726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.045005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.045311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] PATH_INFO: `/v3/users/7de66aab13cb4ea0b756cc6e318b07e4` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.046491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de66aab13cb4ea0b756cc6e318b07e4)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:40.049039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:40.266044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:40.280800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de66aab13cb4ea0b756cc6e318b07e4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:40.281461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de66aab13cb4ea0b756cc6e318b07e4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:40.282869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de66aab13cb4ea0b756cc6e318b07e4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:40.300056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de66aab13cb4ea0b756cc6e318b07e4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:40.395382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de66aab13cb4ea0b756cc6e318b07e4'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:40.417715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1118/2230] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:39 2022] DELETE /identity/v3/users/7de66aab13cb4ea0b756cc6e318b07e4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:40.422775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.423201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.423797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.446823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:40.447999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:40.512505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:40.537103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1113/2231] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:40.545820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:40.547395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:40.628503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fe5de-1110-40cb-a8d9-5eb610d996ab admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:40.632572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5f858-00a4-4358-9968-0bc65bec02bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:40.633208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f858-00a4-4358-9968-0bc65bec02bd service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:40.633489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f858-00a4-4358-9968-0bc65bec02bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:40.642558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5f858-00a4-4358-9968-0bc65bec02bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:40.644438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f858-00a4-4358-9968-0bc65bec02bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:40.645987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5f858-00a4-4358-9968-0bc65bec02bd service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:40.656207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1119/2232] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:41.182899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.189402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:41.227117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a07d9b-7b1b-4e7b-b071-12a41620f924 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.250696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:41.252248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.252540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.252811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] PATH_INFO: `/v3/projects/2ec345705ae3468184619da13f19ac43` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.254063 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec345705ae3468184619da13f19ac43)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.256341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:41.462614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec345705ae3468184619da13f19ac43', 'request_id': 'req-633d694c-5851-4ecc-bb30-335befb3a358'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:41.483588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec345705ae3468184619da13f19ac43', 'request_id': 'req-633d694c-5851-4ecc-bb30-335befb3a358'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:41.491805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec345705ae3468184619da13f19ac43', 'request_id': 'req-633d694c-5851-4ecc-bb30-335befb3a358'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:41.559402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] The token cache is being invalidate because project 2ec345705ae3468184619da13f19ac43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:41.560317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:41.562738 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-633d694c-5851-4ecc-bb30-335befb3a358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:41.566196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1114/2233] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:41 2022] DELETE /identity/v3/projects/2ec345705ae3468184619da13f19ac43 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:41.571094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.571599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.571824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.599548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:41.599548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:41.680581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1120/2234] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:41.682952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.683394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.683832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.724799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:41.727332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:41.739352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1115/2235] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:41.744121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.755053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453c528-6ecb-41e5-817e-1411534f2d7a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.761224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:41.761869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.762154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.762426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.763080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:50:41.763396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.765086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:41.778807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1121/2236] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:50:41.786029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.797061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3d0aa-b6ca-4595-9577-61d9eb894f27 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.804235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:41.804904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:41.805180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:41.805451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:41.806113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:41.808019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:41.934552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1116/2237] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:41 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:41.938914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:41.949238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b61238-00a7-4661-829e-36edc5499011 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:41.992928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:42.015508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.016187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.016497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.016770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.018242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.020455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.110311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1122/2238] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:41 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:42.115070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.128824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430d0ae-297c-4354-a4e2-0d5a4cca8277 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.135208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.135834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.136132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.136418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.137227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.138917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.152145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1117/2239] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:42.156382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.168231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4222f8d-8697-499f-90a8-56c9b91c9265 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.173185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929de423-4513-44e4-b37a-87cd5947f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.173904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de423-4513-44e4-b37a-87cd5947f229 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.174176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de423-4513-44e4-b37a-87cd5947f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.174460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929de423-4513-44e4-b37a-87cd5947f229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.175107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929de423-4513-44e4-b37a-87cd5947f229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.176738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929de423-4513-44e4-b37a-87cd5947f229 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.187574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1123/2240] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:42.192422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.203777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11ff2a-8c08-4e6e-8482-262b564aab86 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.213609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.214951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.217520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.217520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] PATH_INFO: `/v3/projects/c5f987f310234c438bf16e56a12a0516/users/3d9656cdb29f409594d80586a21f7fb3/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.245892 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f987f310234c438bf16e56a12a0516, user_id=3d9656cdb29f409594d80586a21f7fb3, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.252901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.321746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1118/2241] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:42 2022] PUT /identity/v3/projects/c5f987f310234c438bf16e56a12a0516/users/3d9656cdb29f409594d80586a21f7fb3/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:42.334641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.335134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.335134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.527990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] MFA Rules not processed for user `3d9656cdb29f409594d80586a21f7fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:42.529497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:42.735808 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1124/2242] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:42.736779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.736779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd170f87-8786-46d1-9e86-b53eaf127040 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.736779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.736779 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.737178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.737178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.737178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.737178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:42.737178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:42.826035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1119/2243] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:42 2022] POST /identity/v3/projects => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:42.830338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:42.840893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb0fcd-08a0-4118-9fc9-51fa6ad7206c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:42.900064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:42.900723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:42.901006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:42.901275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:42.902056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:42.906462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.020675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1125/2244] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:42 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:43.022795 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.034604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4489bd-73fc-4b79-bff0-fce98f95ea48 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.039472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.040225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.040505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.040776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.041421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.043106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.055884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1120/2245] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:43.059600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.070373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345179-b958-40b3-af63-81c81c86211b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.075107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8634c2-5736-4a47-8a28-adf11ebaf632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.075704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8634c2-5736-4a47-8a28-adf11ebaf632 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.075981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8634c2-5736-4a47-8a28-adf11ebaf632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.076251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8634c2-5736-4a47-8a28-adf11ebaf632 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.076889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8634c2-5736-4a47-8a28-adf11ebaf632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.078638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8634c2-5736-4a47-8a28-adf11ebaf632 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.088675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1126/2246] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:43.096912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.106814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcefa71f-7ef9-4165-ac80-660a8dd0b9de admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.112124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.112867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.113125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.113409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] PATH_INFO: `/v3/projects/017f0940b17b44ad8d5b11835bb6d859/users/1f5f48d5f27f49249ce35aea984c02fd/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.128702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=017f0940b17b44ad8d5b11835bb6d859, user_id=1f5f48d5f27f49249ce35aea984c02fd, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.131469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.214335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1121/2247] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:43 2022] PUT /identity/v3/projects/017f0940b17b44ad8d5b11835bb6d859/users/1f5f48d5f27f49249ce35aea984c02fd/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:43.227703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.228027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.228357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.268425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] MFA Rules not processed for user `1f5f48d5f27f49249ce35aea984c02fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:43.269656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:43.284807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:43.354106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1127/2248] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:43.357619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.468032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54caec-361a-4ae0-824f-b95e7c40f7eb admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.484232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.485017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.485361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.485914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.486649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.488943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.610174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1122/2249] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:50:43 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:43.614883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.627860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fa5ec-a43a-40cc-8f65-8509a181d861 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.700192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.700810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.701090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.701359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.702036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.704564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.820641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1128/2250] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:50:43 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:50:43.825379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.844090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf6ec4-c01f-41f2-a5af-95b4826cb92b admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.849327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.850319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.850636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.850917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.851604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.853445 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.869803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1123/2251] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:43.871698 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:43.883949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b645f-3c8c-4faf-853c-928121814174 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:43.888782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:43.889448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:43.889728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:43.890043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] PATH_INFO: `/v3/projects/ce1477103f174c1e9a8a0a32b26827f3/users/d9abfc6e962e4e868c0e1717992d8807/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:43.906493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1477103f174c1e9a8a0a32b26827f3, user_id=d9abfc6e962e4e868c0e1717992d8807, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:43.909618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:43.999230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1129/2252] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:43 2022] PUT /identity/v3/projects/ce1477103f174c1e9a8a0a32b26827f3/users/d9abfc6e962e4e868c0e1717992d8807/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:50:44.000610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.016103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0d8ba-7a6f-4798-91ee-a7c28c046296 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.087747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f00b9b-e131-41dd-8f40-97c8c154e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.088453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f00b9b-e131-41dd-8f40-97c8c154e653 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.088747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f00b9b-e131-41dd-8f40-97c8c154e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.089099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f00b9b-e131-41dd-8f40-97c8c154e653 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.089931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f00b9b-e131-41dd-8f40-97c8c154e653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.091752 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f00b9b-e131-41dd-8f40-97c8c154e653 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.103975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1124/2253] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:50:44.109133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.123623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f613fcc3-955e-4a02-927b-d443584820e5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.132013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.132768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.133470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.133828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] PATH_INFO: `/v3/projects/ce1477103f174c1e9a8a0a32b26827f3/users/d9abfc6e962e4e868c0e1717992d8807/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.136901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1477103f174c1e9a8a0a32b26827f3, user_id=d9abfc6e962e4e868c0e1717992d8807, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.139884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.158900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1130/2254] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:50:44 2022] PUT /identity/v3/projects/ce1477103f174c1e9a8a0a32b26827f3/users/d9abfc6e962e4e868c0e1717992d8807/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:44.169465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.169743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.170273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.203804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] MFA Rules not processed for user `d9abfc6e962e4e868c0e1717992d8807`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:44.205482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:44.231818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:44.318698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1125/2255] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:50:44.328221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:44.331670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:44.441892 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d151f-635f-469e-81ad-76ff8906af3a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:44.447240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1b1cf-33ac-4054-83fa-1f7723751140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:44.448036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1b1cf-33ac-4054-83fa-1f7723751140 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:44.448477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1b1cf-33ac-4054-83fa-1f7723751140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:44.448852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1b1cf-33ac-4054-83fa-1f7723751140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:44.494550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:44.538964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1b1cf-33ac-4054-83fa-1f7723751140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:44.540428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1b1cf-33ac-4054-83fa-1f7723751140 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:44.550918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1131/2256] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:50:47.861245 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:47.873641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4defcf-ee7b-4864-a9df-4b061b633722 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:47.879490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:47.879490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:47.879490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:47.879490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:47.959115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:47.961329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:47.976808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1126/2257] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:48.352572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:48.353214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:48.353214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:48.375717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] MFA Rules not processed for user `a7a6eb1ae2eb4110b6bd689740769aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:48.377551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:48.446538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1132/2258] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:49.612899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:49.624392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54dd77-1e74-4da2-bb09-a10936f3c33e service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:49.630183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e87437-0e55-4346-8d79-978f75a98b14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:49.630999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87437-0e55-4346-8d79-978f75a98b14 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:49.631286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87437-0e55-4346-8d79-978f75a98b14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:49.631560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e87437-0e55-4346-8d79-978f75a98b14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:49.644232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87437-0e55-4346-8d79-978f75a98b14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:49.645787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e87437-0e55-4346-8d79-978f75a98b14 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:49.659601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1127/2259] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:54.188468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:54.191625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:54.272524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf6def-185b-4890-864d-b5cdec97a4f6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:54.278515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:54.279138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:54.279424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:54.279703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:54.281813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:54.300132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:54.301903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:54.312251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1133/2260] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:54.991819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:54.992338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:54.992338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:55.017885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:55.017885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:55.070319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1128/2261] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 24 03:50:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:55.084121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:55.085603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:55.141429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:55.155027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68845b0-4dc1-43a3-9e2d-264eb930044b service placement] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:55.160180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d343a-bb0e-4cb7-932d-9d624188efd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:55.160783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d343a-bb0e-4cb7-932d-9d624188efd0 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:55.161061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d343a-bb0e-4cb7-932d-9d624188efd0 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:55.161327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d343a-bb0e-4cb7-932d-9d624188efd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:55.169602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d343a-bb0e-4cb7-932d-9d624188efd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:55.174441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d343a-bb0e-4cb7-932d-9d624188efd0 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:55.181743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1134/2262] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:50:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:50:57.825864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:57.893514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:57.914310 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff27237-d7bf-4a4a-be52-6980015bea77 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:57.920811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:57.921957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:57.922243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:57.922749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] PATH_INFO: `/v3/users/3d9656cdb29f409594d80586a21f7fb3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:57.926119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9656cdb29f409594d80586a21f7fb3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:57.930300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:58.134906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9656cdb29f409594d80586a21f7fb3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:58.135627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9656cdb29f409594d80586a21f7fb3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:58.136285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9656cdb29f409594d80586a21f7fb3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:58.159027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9656cdb29f409594d80586a21f7fb3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:58.249257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9656cdb29f409594d80586a21f7fb3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:58.267671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1129/2263] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:57 2022] DELETE /identity/v3/users/3d9656cdb29f409594d80586a21f7fb3 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:58.272394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:58.273022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:58.273583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:58.303776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:50:58.305041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:58.380660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1135/2264] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:50:58.390676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:58.392834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:58.490254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8064d2-ded5-4e46-a498-b8b3363ba4c0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:58.494071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:58.494782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:58.499457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:58.499457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:58.515097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:58.518321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:58.544767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1130/2265] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:50:59.061965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:59.063568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:59.079002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1303917-763d-49b8-8dd4-cef064788927 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:59.084846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:59.089568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:59.089568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:59.089568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] PATH_INFO: `/v3/users/3589f2353d224fea87a654dd098b69a2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:59.089568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3589f2353d224fea87a654dd098b69a2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:59.090611 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:59.267206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:59.268652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:59.293685 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757d1fe-b0c0-407d-804e-89e85da49471 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:59.321857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:59.322904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:59.323362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:59.324003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] PATH_INFO: `/v3/projects/c5f987f310234c438bf16e56a12a0516` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:59.326213 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f987f310234c438bf16e56a12a0516)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:59.328533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:59.358242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3589f2353d224fea87a654dd098b69a2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.360526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3589f2353d224fea87a654dd098b69a2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.362053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3589f2353d224fea87a654dd098b69a2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.376589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3589f2353d224fea87a654dd098b69a2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.487489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f987f310234c438bf16e56a12a0516', 'request_id': 'req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.495169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f987f310234c438bf16e56a12a0516', 'request_id': 'req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.498980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3589f2353d224fea87a654dd098b69a2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.504514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:59.504514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f987f310234c438bf16e56a12a0516', 'request_id': 'req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.513933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1136/2266] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:59 2022] DELETE /identity/v3/users/3589f2353d224fea87a654dd098b69a2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:59.588757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] The token cache is being invalidate because project c5f987f310234c438bf16e56a12a0516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:50:59.589186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.593118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.594800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1131/2267] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:59 2022] DELETE /identity/v3/projects/c5f987f310234c438bf16e56a12a0516 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:50:59.599565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:59.601430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:59.714916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f7c5-28ae-45c9-8ad7-8c0dff4a6319 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:59.721181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:59.721858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:59.722369 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:59.722652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] PATH_INFO: `/v3/users/1f5f48d5f27f49249ce35aea984c02fd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:59.723846 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5f48d5f27f49249ce35aea984c02fd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:59.725978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:59.728387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:50:59.809662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:50:59.811115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:50:59.895618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48dec0-72a9-42b3-b4a7-c20f138a26a3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:50:59.900225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:50:59.900854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:50:59.901134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:50:59.901410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] PATH_INFO: `/v3/projects/ba5ab194269e4bef9044ed070d0ec817` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:50:59.902556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5ab194269e4bef9044ed070d0ec817)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:50:59.904462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:50:59.957441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5f48d5f27f49249ce35aea984c02fd'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.958327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5f48d5f27f49249ce35aea984c02fd'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.958948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5f48d5f27f49249ce35aea984c02fd'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:50:59.977375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5f48d5f27f49249ce35aea984c02fd'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.020918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5ab194269e4bef9044ed070d0ec817', 'request_id': 'req-9d231872-6c4d-4ad0-bf02-365c58c104f7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.027592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5ab194269e4bef9044ed070d0ec817', 'request_id': 'req-9d231872-6c4d-4ad0-bf02-365c58c104f7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.034272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5ab194269e4bef9044ed070d0ec817', 'request_id': 'req-9d231872-6c4d-4ad0-bf02-365c58c104f7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.054759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-bb01480e-376b-4cce-ab2b-65ba41c876c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5f48d5f27f49249ce35aea984c02fd'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.073079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1137/2268] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:50:59 2022] DELETE /identity/v3/users/1f5f48d5f27f49249ce35aea984c02fd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:00.163282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] The token cache is being invalidate because project ba5ab194269e4bef9044ed070d0ec817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:00.163947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.165136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-9d231872-6c4d-4ad0-bf02-365c58c104f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:00.167856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1132/2269] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:50:59 2022] DELETE /identity/v3/projects/ba5ab194269e4bef9044ed070d0ec817 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:00.174145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e712356-7233-4421-9f02-93792b154c6f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.175346 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e712356-7233-4421-9f02-93792b154c6f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.175875 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e712356-7233-4421-9f02-93792b154c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.208994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0e712356-7233-4421-9f02-93792b154c6f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:00.210467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0e712356-7233-4421-9f02-93792b154c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:00.272919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1138/2270] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:00.281193 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.281724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.281724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.302925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:00.304731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:00.312912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1133/2271] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:00.317120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e712356-7233-4421-9f02-93792b154c6f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.326968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e712356-7233-4421-9f02-93792b154c6f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.332188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.332806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.333644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.333644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.334012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:51:00.334318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.336027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.353362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1139/2272] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:51:00.358379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.369308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657f9fc-e11f-498e-a2ff-24033b70d6ff None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.374473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.375173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.375525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.375874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.376788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.379031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.496503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1134/2273] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:00 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:00.500457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.514485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bd91a-74db-459e-9c90-ce09ab48a2b0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.587715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.588452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.588802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.589178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.590479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.591999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.671715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1140/2274] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:00 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:00.676643 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.691646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8916007-aa36-4d4c-8d65-66f0a085ee60 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.696746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.697399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.697705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.698111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.698720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.700316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.712328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1135/2275] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:00.716512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.727895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043a354-af72-4dc6-b543-adc9641cb6c0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.732890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.733496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.733814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.734091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.734738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.736363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.751243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1141/2276] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:00.753159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.763370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494659d7-116b-4ad6-8d84-9dfd24c5d7f0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.768553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c09db-8d64-4d23-83dd-85fd6b81c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.769203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c09db-8d64-4d23-83dd-85fd6b81c89d admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.769483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c09db-8d64-4d23-83dd-85fd6b81c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.769757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c09db-8d64-4d23-83dd-85fd6b81c89d admin admin] PATH_INFO: `/v3/projects/42d9689c9529443588958dd64b69dbaf/users/46cbc03fbc0149f984fc751132df990b/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.785388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c09db-8d64-4d23-83dd-85fd6b81c89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d9689c9529443588958dd64b69dbaf, user_id=46cbc03fbc0149f984fc751132df990b, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.788081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c09db-8d64-4d23-83dd-85fd6b81c89d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.815641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:00.817697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:00.831531 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8c418-2cee-4872-98b0-b6029f9b37d9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:00.836756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:00.837400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.837681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.837986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] PATH_INFO: `/v3/projects/017f0940b17b44ad8d5b11835bb6d859` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.839123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017f0940b17b44ad8d5b11835bb6d859)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:00.841205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:00.884415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1136/2277] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:00 2022] PUT /identity/v3/projects/42d9689c9529443588958dd64b69dbaf/users/46cbc03fbc0149f984fc751132df990b/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:00.887885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:00.895240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:00.895536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:00.895836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:00.922485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:00.925630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] MFA Rules not processed for user `46cbc03fbc0149f984fc751132df990b`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:00.926951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.001959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1137/2278] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:01.012289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017f0940b17b44ad8d5b11835bb6d859', 'request_id': 'req-c7b51713-7b1d-4f28-882e-ffadf828ae63'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.013212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:01.014767 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.019694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017f0940b17b44ad8d5b11835bb6d859', 'request_id': 'req-c7b51713-7b1d-4f28-882e-ffadf828ae63'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.073290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac459a17-1a27-4d45-8dab-e2fe27d13799 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:01.081988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017f0940b17b44ad8d5b11835bb6d859', 'request_id': 'req-c7b51713-7b1d-4f28-882e-ffadf828ae63'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.093593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] The token cache is being invalidate because project 017f0940b17b44ad8d5b11835bb6d859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:01.094043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.094872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.097090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1142/2279] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:00 2022] DELETE /identity/v3/projects/017f0940b17b44ad8d5b11835bb6d859 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:01.100945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:01.102326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.123377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:01.124015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:01.124290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:01.124578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:01.126358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.167655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b51713-7b1d-4f28-882e-ffadf828ae63 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:01.172913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:01.177184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:01.177184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:01.177184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] PATH_INFO: `/v3/users/d9abfc6e962e4e868c0e1717992d8807` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:01.177184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9abfc6e962e4e868c0e1717992d8807)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:01.177555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:01.186970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:01.188418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:01.197914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1138/2280] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:01.222689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:01.224171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.240736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc8b5-749a-4b77-99f4-4e3235d9f2a0 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:01.243389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:01.244037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:01.244319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:01.244594 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] PATH_INFO: `/v3/users/46cbc03fbc0149f984fc751132df990b` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:01.245742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cbc03fbc0149f984fc751132df990b)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:01.247769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:01.467847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9abfc6e962e4e868c0e1717992d8807'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.468500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9abfc6e962e4e868c0e1717992d8807'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.469322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9abfc6e962e4e868c0e1717992d8807'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.482356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9abfc6e962e4e868c0e1717992d8807'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.531341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cbc03fbc0149f984fc751132df990b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.532024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cbc03fbc0149f984fc751132df990b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.532886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cbc03fbc0149f984fc751132df990b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.545661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cbc03fbc0149f984fc751132df990b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.597897 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-045d924d-972b-4e9e-884e-ce0b4bb74310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9abfc6e962e4e868c0e1717992d8807'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.612501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1143/2281] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:01 2022] DELETE /identity/v3/users/d9abfc6e962e4e868c0e1717992d8807 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:01.685947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cbc03fbc0149f984fc751132df990b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:01.700387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1139/2282] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:01 2022] DELETE /identity/v3/users/46cbc03fbc0149f984fc751132df990b => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:01.704756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:01.704978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:01.705252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:01.726244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:01.727461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.790176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1144/2283] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:01.828628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:01.828628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:01.863491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea75c95-4abf-4cdf-9026-fcc095b10f84 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:01.867655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:01.868225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:01.868506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:01.868785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:01.879676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:01.881202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:01.893035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1140/2284] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:01.957478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:01.985484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:02.424792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:02.426495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:02.440029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3bc820-2cf3-41f6-bfad-a413875130f8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:02.445669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:02.446634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:02.446769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:02.447128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] PATH_INFO: `/v3/projects/ce1477103f174c1e9a8a0a32b26827f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:02.449171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1477103f174c1e9a8a0a32b26827f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:02.451252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:02.572150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1477103f174c1e9a8a0a32b26827f3', 'request_id': 'req-c73f1703-6581-4779-8366-4fede1f4d27b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.580411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1477103f174c1e9a8a0a32b26827f3', 'request_id': 'req-c73f1703-6581-4779-8366-4fede1f4d27b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.692672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:02.694785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:02.717150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040af78-d42d-48a5-9e31-d442ea309470 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:02.749154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1477103f174c1e9a8a0a32b26827f3', 'request_id': 'req-c73f1703-6581-4779-8366-4fede1f4d27b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.764735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] The token cache is being invalidate because project ce1477103f174c1e9a8a0a32b26827f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:02.765055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.765733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c73f1703-6581-4779-8366-4fede1f4d27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.770886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1145/2285] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:02 2022] DELETE /identity/v3/projects/ce1477103f174c1e9a8a0a32b26827f3 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:02.772940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2e7a9-95e2-4c17-944a-89bae93466cd None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:02.773229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2e7a9-95e2-4c17-944a-89bae93466cd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:02.773506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2e7a9-95e2-4c17-944a-89bae93466cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:02.803858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-b6e2e7a9-95e2-4c17-944a-89bae93466cd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:02.804611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:02.805433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:02.805720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:02.806069 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] PATH_INFO: `/v3/projects/42d9689c9529443588958dd64b69dbaf` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:02.807227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d9689c9529443588958dd64b69dbaf)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:02.809181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:02.810221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b6e2e7a9-95e2-4c17-944a-89bae93466cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:02.820213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1146/2286] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:02.888591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:02.888880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:02.889155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:02.909208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:02.910396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:02.918456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1147/2287] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:02.927999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:02.937277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2082c9-ed28-4c53-a714-05fb3eb17c85 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:02.942511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:02.943096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:02.943375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:02.943647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:02.944284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:51:02.944588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:02.946345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:02.949183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:02.958837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1148/2288] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:51:02.962477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d9689c9529443588958dd64b69dbaf', 'request_id': 'req-95f495d0-d709-4554-927d-a8109cb62eea'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.962904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:02.968783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d9689c9529443588958dd64b69dbaf', 'request_id': 'req-95f495d0-d709-4554-927d-a8109cb62eea'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:02.973605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a91e7-1ef5-4b61-bc58-ebdf8ec985c3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:02.974959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d9689c9529443588958dd64b69dbaf', 'request_id': 'req-95f495d0-d709-4554-927d-a8109cb62eea'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:03.016724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.037322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.037970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.038261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.038535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.039282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.041225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.087124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] The token cache is being invalidate because project 42d9689c9529443588958dd64b69dbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:03.087427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:03.088133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-95f495d0-d709-4554-927d-a8109cb62eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:03.089670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1141/2289] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:02 2022] DELETE /identity/v3/projects/42d9689c9529443588958dd64b69dbaf => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:03.096431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f083-42f4-4f90-bf0b-953ce24cc22d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.096716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f083-42f4-4f90-bf0b-953ce24cc22d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.097004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f083-42f4-4f90-bf0b-953ce24cc22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.121121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c846f083-42f4-4f90-bf0b-953ce24cc22d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:03.122382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c846f083-42f4-4f90-bf0b-953ce24cc22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:03.130922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1142/2290] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:03.138633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.138923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.139200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.181458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:03.181458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:03.181458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1143/2291] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:03.184457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.194369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd97c-afcd-4cbd-8542-c00f028df5aa None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.199162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.199763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.200043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.200323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.200967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:51:03.201270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.202907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.211566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1149/2292] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:02 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:03.212830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.215791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:03.216298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1144/2293] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:51:03.229311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.241308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabb885-72ac-404e-a9ca-15662dd19928 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.287504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00869b86-8f11-4491-8c58-f7a1b9e9e190 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.296340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.296977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.297341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.297526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.298217 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.300438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.332325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.332947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.333805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.333805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.334152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.336210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.400287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1150/2294] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:03 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:03.413201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.426713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d482d3-3c9f-4d60-93e5-9f2d30fbc264 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.432221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.432777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.433060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.433325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.434007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.435728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.444472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1145/2295] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:03 2022] POST /identity/v3/projects => generated 391 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:03.451492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1151/2296] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:03.456799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.458941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.469330 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516591ee-9c14-4203-8e17-44a34e499f6f admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.539244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.539817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.540098 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.540374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.541028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.542758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.546206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7acad19-e80d-45a0-850f-431503be5a14 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.551995 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.552607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.552884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.553151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.553934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.554077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1152/2297] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:03.555880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.561816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.572796 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db409381-b16b-4cf6-a9ce-450636de7aa5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.577561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29000f50-5fb4-4aa5-b3b5-62ea5d213263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.578248 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29000f50-5fb4-4aa5-b3b5-62ea5d213263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.578526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29000f50-5fb4-4aa5-b3b5-62ea5d213263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.578800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29000f50-5fb4-4aa5-b3b5-62ea5d213263 admin admin] PATH_INFO: `/v3/projects/d2ec5acb44444e36a3b95aec9c95389a/users/07c95009004f4369ae0989b4d7a1808b/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.598310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29000f50-5fb4-4aa5-b3b5-62ea5d213263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ec5acb44444e36a3b95aec9c95389a, user_id=07c95009004f4369ae0989b4d7a1808b, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.600971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29000f50-5fb4-4aa5-b3b5-62ea5d213263 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.660552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1146/2298] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:03 2022] POST /identity/v3/users => generated 296 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:03.665298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.676506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45bfc60-9719-4816-9260-e545489f5049 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.681580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.682288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.682515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.682790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.683510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.685131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.686722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.699462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1147/2299] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:51:03.703040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.730382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1153/2300] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:03 2022] PUT /identity/v3/projects/d2ec5acb44444e36a3b95aec9c95389a/users/07c95009004f4369ae0989b4d7a1808b/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:03.730553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5997bb-f516-4e0c-a778-4b3d3f6c5d52 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.730646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.730646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.730646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.773432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] MFA Rules not processed for user `07c95009004f4369ae0989b4d7a1808b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:03.774715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:03.794675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:03.813033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.814282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.814661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.815095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.816879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.818442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.830878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1148/2301] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:51:03.836653 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.850692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b130f3d-2a91-4a78-ab4e-c1a323f7ef2f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.856060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.856960 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.857286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.857635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] PATH_INFO: `/v3/projects/8432bf76d7d8403aa9a2b566c2066c19/users/3d264df7670742aa97ccedada14ce9e2/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.870177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1154/2302] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:03.884289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:03.885717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:03.898674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8432bf76d7d8403aa9a2b566c2066c19, user_id=3d264df7670742aa97ccedada14ce9e2, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.901580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.957461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f3580-3aad-4a85-b195-a1cebbee185a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:03.961514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2b574-e519-4dd8-80c8-bfdbc313f506 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:03.962200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b574-e519-4dd8-80c8-bfdbc313f506 service glance] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:03.962482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b574-e519-4dd8-80c8-bfdbc313f506 service glance] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:03.962766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2b574-e519-4dd8-80c8-bfdbc313f506 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:03.973250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2b574-e519-4dd8-80c8-bfdbc313f506 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:03.974724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2b574-e519-4dd8-80c8-bfdbc313f506 service glance] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:03.988113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1155/2303] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:03.997282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1149/2304] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:03 2022] PUT /identity/v3/projects/8432bf76d7d8403aa9a2b566c2066c19/users/3d264df7670742aa97ccedada14ce9e2/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:04.012830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:04.013176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:04.013509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:04.051699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] MFA Rules not processed for user `3d264df7670742aa97ccedada14ce9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:04.052936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:04.129817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1156/2305] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:04.140483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:04.144684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:04.205537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89241a40-b98a-4801-920a-04e33779e8cc admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:04.209359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2c5ad-f95c-493e-8180-b4fa16896c85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:04.210070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c5ad-f95c-493e-8180-b4fa16896c85 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:04.212663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c5ad-f95c-493e-8180-b4fa16896c85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:04.212663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2c5ad-f95c-493e-8180-b4fa16896c85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:04.219645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2c5ad-f95c-493e-8180-b4fa16896c85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:04.221803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec2c5ad-f95c-493e-8180-b4fa16896c85 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:04.233889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1150/2306] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:14.233281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:14.294056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=81 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:17.774790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:17.778738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:17.887364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4582d-4fdc-4d50-8af2-0ad20de40e9e None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:17.894545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:17.895537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:17.896081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:17.896541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] PATH_INFO: `/v3/users/04ab6ea1e64f4a26856b0bc59fc7553f` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:17.897913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ab6ea1e64f4a26856b0bc59fc7553f)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:17.899939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:18.203527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ab6ea1e64f4a26856b0bc59fc7553f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:18.203527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ab6ea1e64f4a26856b0bc59fc7553f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:18.203527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ab6ea1e64f4a26856b0bc59fc7553f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:18.222686 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ab6ea1e64f4a26856b0bc59fc7553f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:18.390350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ab6ea1e64f4a26856b0bc59fc7553f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:18.406772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1157/2307] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:17 2022] DELETE /identity/v3/users/04ab6ea1e64f4a26856b0bc59fc7553f => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:18.412551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4fc5-01bd-4475-a14e-2e95695bd916 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:18.413420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4fc5-01bd-4475-a14e-2e95695bd916 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:18.413703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4fc5-01bd-4475-a14e-2e95695bd916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:18.441417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8f7c4fc5-01bd-4475-a14e-2e95695bd916 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:18.443806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8f7c4fc5-01bd-4475-a14e-2e95695bd916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:18.541319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1151/2308] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:18.552041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:18.553546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:18.625736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b473e7-98f5-4afb-9772-fc767c63602a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:18.630674 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:18.631297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:18.631578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:18.631850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:18.644337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:18.647986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:18.658052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1158/2309] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:18.715956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:18.716825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:18.718151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:18.789029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:18.790691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:18.812623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1152/2310] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:18.851272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:18.853571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:18.883588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:18.939604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81e77e-2a48-468e-970e-7249a920b09e service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:18.945663 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfffd64-8478-4644-857f-fc453bb21a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:18.946324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfffd64-8478-4644-857f-fc453bb21a38 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:18.946684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfffd64-8478-4644-857f-fc453bb21a38 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:18.946959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfffd64-8478-4644-857f-fc453bb21a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:18.956020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfffd64-8478-4644-857f-fc453bb21a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:18.957650 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfffd64-8478-4644-857f-fc453bb21a38 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:18.968648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1159/2311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:19.285894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:19.287498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:19.305427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf4df8-9e5a-486b-b2b3-e0e196b632de None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:19.310133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:19.310966 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:19.311324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:19.311669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] PATH_INFO: `/v3/projects/3eb4ef9fd91d4c588bfa89b157d69dc2` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:19.313261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb4ef9fd91d4c588bfa89b157d69dc2)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:19.315276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:19.515695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb4ef9fd91d4c588bfa89b157d69dc2', 'request_id': 'req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:19.524516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb4ef9fd91d4c588bfa89b157d69dc2', 'request_id': 'req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:19.531427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb4ef9fd91d4c588bfa89b157d69dc2', 'request_id': 'req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:19.644126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] The token cache is being invalidate because project 3eb4ef9fd91d4c588bfa89b157d69dc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:19.644505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:19.645274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d6e4dec5-7ff0-4c25-bfc7-e059434023d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:19.647131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1153/2312] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:19 2022] DELETE /identity/v3/projects/3eb4ef9fd91d4c588bfa89b157d69dc2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:19.653438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f64c8-a930-4032-9267-4838180bd339 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:19.653724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f64c8-a930-4032-9267-4838180bd339 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:19.654022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f64c8-a930-4032-9267-4838180bd339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:19.678076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-403f64c8-a930-4032-9267-4838180bd339 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:19.679383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-403f64c8-a930-4032-9267-4838180bd339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:19.749914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1160/2313] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:19.758346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:19.758818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:19.758917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:19.779912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:19.781126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:19.790661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1154/2314] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:19.795156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f64c8-a930-4032-9267-4838180bd339 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:19.805324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f64c8-a930-4032-9267-4838180bd339 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:19.812764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:19.815633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:19.815633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:19.815633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:19.815633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:51:19.815633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:19.817359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:19.830320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1161/2315] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:51:19.835459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:19.846467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5e02c-546e-4dbf-9f62-ce631bd6549c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:19.851854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:19.852483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:19.852768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:19.853101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:19.853757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:19.855770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:19.935592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1155/2316] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:19 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:19.936695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:19.947712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250730c6-bbdd-40f8-bc66-983d36679cb1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:20.023986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:20.024679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:20.025057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:20.025433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:20.026226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:20.028150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:20.142543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1162/2317] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:19 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:20.143889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:20.168876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79324-2a7d-48a8-a441-e319600187d9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:20.175334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:20.176033 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:20.176713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:20.177056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:20.177825 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:20.179636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:20.192729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1156/2318] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:20.197343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:20.208238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b2d78-2065-4ea9-9a6c-2b79d4bff7d9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:20.213303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41394299-a443-45cf-b22a-0fd5659ddc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:20.213898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394299-a443-45cf-b22a-0fd5659ddc8c admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:20.214182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394299-a443-45cf-b22a-0fd5659ddc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:20.218358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41394299-a443-45cf-b22a-0fd5659ddc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:20.218358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41394299-a443-45cf-b22a-0fd5659ddc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:20.218358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41394299-a443-45cf-b22a-0fd5659ddc8c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:20.231291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1163/2319] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:51:20.235709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:20.246864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c927dc5-02a5-4bc2-902e-e01637c3e671 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:20.251824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:20.253149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:20.253492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:20.253868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] PATH_INFO: `/v3/projects/7b17c8177653461591422016adc790bf/users/d213f0b2ecd34c0581bcfc1f8b56d479/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:20.285216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b17c8177653461591422016adc790bf, user_id=d213f0b2ecd34c0581bcfc1f8b56d479, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:20.287151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:20.407574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1157/2320] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:20 2022] PUT /identity/v3/projects/7b17c8177653461591422016adc790bf/users/d213f0b2ecd34c0581bcfc1f8b56d479/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:20.418898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:20.419185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:20.419461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:20.445261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:20.451379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] MFA Rules not processed for user `d213f0b2ecd34c0581bcfc1f8b56d479`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:20.451379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:20.515111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1164/2321] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:20.526317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:20.528271 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:20.546076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:20.594809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99d23c-0f6d-4fcb-92ea-5f3796144882 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:20.599196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6c119-b149-49aa-8b9f-2720784556b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:20.599810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c119-b149-49aa-8b9f-2720784556b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:20.600095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c119-b149-49aa-8b9f-2720784556b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:20.600375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c119-b149-49aa-8b9f-2720784556b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:20.609103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6c119-b149-49aa-8b9f-2720784556b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:20.610587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6c119-b149-49aa-8b9f-2720784556b7 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:20.620659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1158/2322] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:25.125345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:25.126835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:25.194784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642c89d-6268-461d-a399-dccc9dd8525d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:25.199297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:25.199938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:25.200215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:25.200489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] PATH_INFO: `/v3/users/3d264df7670742aa97ccedada14ce9e2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:25.201624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d264df7670742aa97ccedada14ce9e2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:25.203588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:25.509599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d264df7670742aa97ccedada14ce9e2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:25.510291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d264df7670742aa97ccedada14ce9e2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:25.511018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d264df7670742aa97ccedada14ce9e2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:25.527320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d264df7670742aa97ccedada14ce9e2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:25.638333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d264df7670742aa97ccedada14ce9e2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:25.646778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1165/2323] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:25 2022] DELETE /identity/v3/users/3d264df7670742aa97ccedada14ce9e2 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:25.651478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:25.652003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:25.652099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:25.671387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:25.672608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:25.734827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1159/2324] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:25.745108 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:25.746566 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:25.774414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:25.813705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c4c8f-67b6-475c-9060-5c6b3cafa58b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:25.817536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd240b3-372e-43ea-83df-6840962854d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:25.818197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd240b3-372e-43ea-83df-6840962854d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:25.818476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd240b3-372e-43ea-83df-6840962854d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:25.818751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd240b3-372e-43ea-83df-6840962854d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:25.828577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd240b3-372e-43ea-83df-6840962854d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:25.830040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd240b3-372e-43ea-83df-6840962854d0 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:25.840356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1166/2325] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:26.371144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:26.372573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:26.386637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c5a84-d19b-4a39-984c-2ed069838551 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:26.391723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:26.392485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.392851 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.393128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] PATH_INFO: `/v3/projects/8432bf76d7d8403aa9a2b566c2066c19` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.397277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8432bf76d7d8403aa9a2b566c2066c19)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:26.397277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:26.556504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8432bf76d7d8403aa9a2b566c2066c19', 'request_id': 'req-61251bf9-6282-40fa-add7-a0461fb444e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:26.563221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8432bf76d7d8403aa9a2b566c2066c19', 'request_id': 'req-61251bf9-6282-40fa-add7-a0461fb444e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:26.570696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8432bf76d7d8403aa9a2b566c2066c19', 'request_id': 'req-61251bf9-6282-40fa-add7-a0461fb444e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:26.648994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] The token cache is being invalidate because project 8432bf76d7d8403aa9a2b566c2066c19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:26.649220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:26.649989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-61251bf9-6282-40fa-add7-a0461fb444e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:26.651593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1160/2326] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:26 2022] DELETE /identity/v3/projects/8432bf76d7d8403aa9a2b566c2066c19 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:26.656905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.657331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.657471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.678135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:26.679399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:26.753937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1167/2327] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:26.761655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.761968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.762245 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.782509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:26.783995 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:26.792678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1161/2328] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:26.800610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:26.810700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30a052-8bdf-4eeb-b00a-17e1487da76d None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:26.815852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:26.816404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.816670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.816940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.817589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:51:26.818003 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:26.819624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:26.831652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1168/2329] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:51:26.836895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:26.846790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd5f2d-6ba0-4588-86c7-a5affe2e184e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:26.852096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:26.852719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:26.853044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:26.853319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:26.853984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:26.855898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:26.931664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1162/2330] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:26 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:26.936265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:26.946838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf3e78-873c-4bc4-8b0e-7bc4dfc6dba8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:27.003915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:27.004931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.004931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.005183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.005726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:27.007677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:27.084209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1169/2331] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:26 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:51:27.088339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:27.100225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd30cd-8ada-4dc7-83bd-43102df0424a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:27.105101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:27.105710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.106039 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.106349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.106984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:27.108564 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:27.114090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:27.119785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1163/2332] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:27.126819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:27.136888 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2cebc-2849-4306-9a27-b63a320d0e8a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:27.141827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8913a9a-7ede-4710-bad5-f5ec7d2d7ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:27.143288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8913a9a-7ede-4710-bad5-f5ec7d2d7ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.143288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8913a9a-7ede-4710-bad5-f5ec7d2d7ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.143288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8913a9a-7ede-4710-bad5-f5ec7d2d7ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.143896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8913a9a-7ede-4710-bad5-f5ec7d2d7ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:27.145579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8913a9a-7ede-4710-bad5-f5ec7d2d7ae5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:27.156992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1170/2333] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:27.161981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:27.172741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1467de-291b-4bc6-bc15-299050a58313 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:27.178163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:27.178823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.179107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.179411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] PATH_INFO: `/v3/projects/3b4d782ada9040819812a951b1b6e298/users/1ebddb80fdb4411886e6204715a10e0e/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.195013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4d782ada9040819812a951b1b6e298, user_id=1ebddb80fdb4411886e6204715a10e0e, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:27.197590 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:27.371963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1164/2334] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:27 2022] PUT /identity/v3/projects/3b4d782ada9040819812a951b1b6e298/users/1ebddb80fdb4411886e6204715a10e0e/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:27.378169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b463d7-a3eb-4a0f-b0b6-4f6c8adc36b5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.378593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b463d7-a3eb-4a0f-b0b6-4f6c8adc36b5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.378872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b463d7-a3eb-4a0f-b0b6-4f6c8adc36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.406923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d4b463d7-a3eb-4a0f-b0b6-4f6c8adc36b5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:27.406923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d4b463d7-a3eb-4a0f-b0b6-4f6c8adc36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:27.434751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:27.467783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1171/2335] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:27.481411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:27.481411 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:27.548215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ddc5-0afc-4d4d-8b85-0ec66aff09ed admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:27.552759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:27.553591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:27.553918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:27.554195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:27.564605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:27.566083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:27.580911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1165/2336] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:51:30.200273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85d092-a513-435f-abc4-2925309dc82a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:30.201133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85d092-a513-435f-abc4-2925309dc82a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:30.201621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85d092-a513-435f-abc4-2925309dc82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:30.255227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-db85d092-a513-435f-abc4-2925309dc82a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:30.261645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-db85d092-a513-435f-abc4-2925309dc82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:30.290850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1172/2337] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:30.330832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:30.335061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:30.429544 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118a61e-ea68-4d9c-a69e-16bddcc3ddf5 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:30.435673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:30.436317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:30.436783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:30.436916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:30.448374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:30.450934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:30.464893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1166/2338] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:30.799240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2b90-0729-4725-9412-8fb76e81da05 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:30.800073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2b90-0729-4725-9412-8fb76e81da05 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:30.800515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc2b90-0729-4725-9412-8fb76e81da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:30.831407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-aefc2b90-0729-4725-9412-8fb76e81da05 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:30.834167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-aefc2b90-0729-4725-9412-8fb76e81da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:30.952308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1173/2339] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:51:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:30.985516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:30.989644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:31.163056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780729-a7e1-4833-9fa4-5a6eb2a5cfd2 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:31.171735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6d899-5838-448a-aa7c-752e96f82163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:31.172470 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d899-5838-448a-aa7c-752e96f82163 service swift] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:31.172764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d899-5838-448a-aa7c-752e96f82163 service swift] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:31.173042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6d899-5838-448a-aa7c-752e96f82163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:31.181561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:31.190595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6d899-5838-448a-aa7c-752e96f82163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:31.192152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6d899-5838-448a-aa7c-752e96f82163 service swift] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:31.216056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1167/2340] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:31.992919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:31.993429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:31.993705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:32.033185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] MFA Rules not processed for user `dd8808dab1914b269a80addf376bab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:32.036243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:32.143524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1174/2341] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:36.704417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.705355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.705890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.762686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] MFA Rules not processed for user `1ebddb80fdb4411886e6204715a10e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:36.763955 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:36.918632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1168/2342] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:36.923472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:36.935084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb22e82-6ccd-4980-8dd7-2deb85a6af86 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:36.939730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:36.940352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:36.940634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:36.940908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:36.941562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:36.944035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.166442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1175/2343] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:51:36 2022] POST /identity/v3/projects => generated 383 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:51:37.166555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.176174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97198-850c-4606-8225-efa0f1b998f4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.287146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.303593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.303593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.303593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.303593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.304364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.497270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1169/2344] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:51:37 2022] POST /identity/v3/users => generated 298 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:51:37.497920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.516211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff31220-07a7-4f6e-b581-1cd8c3848bad admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.526085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.526722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.527006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.527279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.528123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.529941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.541927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1176/2345] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:37.547395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.559211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bdddb-f731-48b5-9383-0eeafb111155 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.570630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.571724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.572256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.572639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] PATH_INFO: `/v3/projects/70a3340a3a5449e9ad09da56d0fbd64c/users/0bfd87e98ca24267a3da3a32a35f58b3/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.609751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a3340a3a5449e9ad09da56d0fbd64c, user_id=0bfd87e98ca24267a3da3a32a35f58b3, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.612707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:37.761998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1170/2346] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:37 2022] PUT /identity/v3/projects/70a3340a3a5449e9ad09da56d0fbd64c/users/0bfd87e98ca24267a3da3a32a35f58b3/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:51:37.767860 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:37.786509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8357a9-51d3-4015-bc9b-cce15ffb67a3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:37.918093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:37.979229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1521bac6-27cf-474c-aec8-8ba6d7774ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:37.980821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521bac6-27cf-474c-aec8-8ba6d7774ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:37.985612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521bac6-27cf-474c-aec8-8ba6d7774ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:37.986130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1521bac6-27cf-474c-aec8-8ba6d7774ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:37.986998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521bac6-27cf-474c-aec8-8ba6d7774ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:37.988838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1521bac6-27cf-474c-aec8-8ba6d7774ed3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:38.026090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1177/2347] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:51:38.031318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:38.045521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01786d9-70a7-41d0-a56c-8265d1041965 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:38.053606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:38.055338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:38.055869 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:38.056430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] PATH_INFO: `/v3/projects/70a3340a3a5449e9ad09da56d0fbd64c/users/0bfd87e98ca24267a3da3a32a35f58b3/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:38.060112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a3340a3a5449e9ad09da56d0fbd64c, user_id=0bfd87e98ca24267a3da3a32a35f58b3, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:38.063403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:38.077837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1171/2348] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:51:38 2022] PUT /identity/v3/projects/70a3340a3a5449e9ad09da56d0fbd64c/users/0bfd87e98ca24267a3da3a32a35f58b3/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:38.564133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:38.564691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:38.565198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:38.598413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:38.602235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:38.753744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1178/2349] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:38.780025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:38.894419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:38.992616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1611-e38e-49da-aa85-b8c14f75339c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:39.013046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d15fe0-19b9-419a-a52f-e0ce020ca6d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:39.013587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d15fe0-19b9-419a-a52f-e0ce020ca6d9 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:39.015417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d15fe0-19b9-419a-a52f-e0ce020ca6d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:39.015867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d15fe0-19b9-419a-a52f-e0ce020ca6d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:39.040224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d15fe0-19b9-419a-a52f-e0ce020ca6d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:39.044842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d15fe0-19b9-419a-a52f-e0ce020ca6d9 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:39.091023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1172/2350] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:39.872543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:39.874157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:39.894775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f03b-5430-46b3-a033-b5c949e34e0a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:39.902477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:39.903506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:39.903941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:39.908908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] PATH_INFO: `/v3/users/d213f0b2ecd34c0581bcfc1f8b56d479` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:39.908908 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d213f0b2ecd34c0581bcfc1f8b56d479)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:39.914104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:40.259155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd213f0b2ecd34c0581bcfc1f8b56d479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:40.263619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd213f0b2ecd34c0581bcfc1f8b56d479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:40.267512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd213f0b2ecd34c0581bcfc1f8b56d479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:40.320203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd213f0b2ecd34c0581bcfc1f8b56d479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:40.432687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd213f0b2ecd34c0581bcfc1f8b56d479'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:40.461188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1179/2351] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:39 2022] DELETE /identity/v3/users/d213f0b2ecd34c0581bcfc1f8b56d479 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:40.465510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:40.466134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:40.466134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:40.496260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:40.496260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:40.678131 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1173/2352] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:40.704751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:40.706574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:40.870947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199468af-6b03-405d-a06d-dee70272fadd admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:40.877867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a44a70-d6ba-4559-bb80-f37c8a8b000c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:40.878486 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a44a70-d6ba-4559-bb80-f37c8a8b000c service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:40.878772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a44a70-d6ba-4559-bb80-f37c8a8b000c service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:40.879045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a44a70-d6ba-4559-bb80-f37c8a8b000c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:40.894786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:40.907502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a44a70-d6ba-4559-bb80-f37c8a8b000c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:40.909026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a44a70-d6ba-4559-bb80-f37c8a8b000c service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:40.928039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1180/2353] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:42.528749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:42.531378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:42.585827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83797e12-2b43-4a06-a505-a008e9912e93 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:42.585827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:42.585827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:42.585827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:42.586236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] PATH_INFO: `/v3/projects/7b17c8177653461591422016adc790bf` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:42.587198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b17c8177653461591422016adc790bf)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:42.589389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:42.802580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b17c8177653461591422016adc790bf', 'request_id': 'req-24b27f0a-d81b-4c65-8c29-1bda7b14181f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:42.820293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b17c8177653461591422016adc790bf', 'request_id': 'req-24b27f0a-d81b-4c65-8c29-1bda7b14181f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:42.828230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b17c8177653461591422016adc790bf', 'request_id': 'req-24b27f0a-d81b-4c65-8c29-1bda7b14181f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:43.024066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] The token cache is being invalidate because project 7b17c8177653461591422016adc790bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:43.025049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:43.026787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:43.030434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1174/2354] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:42 2022] DELETE /identity/v3/projects/7b17c8177653461591422016adc790bf => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:44.674681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95216-8e41-4e31-a822-67b8723fa7c0 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:44.682565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95216-8e41-4e31-a822-67b8723fa7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:44.682565 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95216-8e41-4e31-a822-67b8723fa7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:44.705493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-46e95216-8e41-4e31-a822-67b8723fa7c0 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:44.706180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-46e95216-8e41-4e31-a822-67b8723fa7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:44.825125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1181/2355] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:44.855963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:44.858354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:44.917236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:44.955313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27f0a-d81b-4c65-8c29-1bda7b14181f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:44.963352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:44.964220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:44.964711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:44.965175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:44.975555 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:44.977571 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:45.009664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1175/2356] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:47.845250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78284bce-9263-428a-985b-c7bcca86aeef None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:47.845855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78284bce-9263-428a-985b-c7bcca86aeef None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:47.846312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78284bce-9263-428a-985b-c7bcca86aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:47.894284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-78284bce-9263-428a-985b-c7bcca86aeef None None] MFA Rules not processed for user `0bfd87e98ca24267a3da3a32a35f58b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:47.897001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-78284bce-9263-428a-985b-c7bcca86aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:48.124869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1182/2357] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:48.126300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:48.137358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:48.230285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9963-94e4-4e44-9397-745458b7648a service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:48.240992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:48.240992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:48.240992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:48.240992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:48.241429 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:48.307693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:48.309135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:48.318604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1176/2358] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:48.875893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:48.875893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:48.875893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:48.880208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:48.881965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:48.939773 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1183/2359] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:51:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:48.966559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:48.966559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:49.054277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a533dff-b756-40fc-91f2-c3fec1537db3 service glance] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:49.061578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b16aa-687d-4ef7-bcd4-ee48b3c1fc69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:49.062494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b16aa-687d-4ef7-bcd4-ee48b3c1fc69 service swift] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:49.062778 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b16aa-687d-4ef7-bcd4-ee48b3c1fc69 service swift] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:49.063050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b16aa-687d-4ef7-bcd4-ee48b3c1fc69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:49.074646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b16aa-687d-4ef7-bcd4-ee48b3c1fc69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:49.076317 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b16aa-687d-4ef7-bcd4-ee48b3c1fc69 service swift] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:49.085805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1177/2360] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:51:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:51:51.272594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:51.274225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:51.291968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bef7f3-97bc-4d0a-a72e-9e106fc171b7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:51.297107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:51.298125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:51.298557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:51.298982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] PATH_INFO: `/v3/users/07c95009004f4369ae0989b4d7a1808b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:51.300279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c95009004f4369ae0989b4d7a1808b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:51.303005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:51.342582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:51.586709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c95009004f4369ae0989b4d7a1808b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:51.587659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c95009004f4369ae0989b4d7a1808b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:51.588457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c95009004f4369ae0989b4d7a1808b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:51.603020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c95009004f4369ae0989b4d7a1808b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:51.685992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c95009004f4369ae0989b4d7a1808b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:51.705368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1184/2361] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:51:51 2022] DELETE /identity/v3/users/07c95009004f4369ae0989b4d7a1808b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:51.710096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:51.711017 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:51.711297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:51.732086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:51.733669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:51.746900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:51:51.842038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1178/2362] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:51:51.850523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:51.852355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:51.944916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70f534-10fb-4946-92f4-43daa53729a2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:51.955700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee318-5ccc-44c1-8be3-2799fcab7ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:51.955700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee318-5ccc-44c1-8be3-2799fcab7ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:51.955700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee318-5ccc-44c1-8be3-2799fcab7ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:51.955700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee318-5ccc-44c1-8be3-2799fcab7ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:51.978110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee318-5ccc-44c1-8be3-2799fcab7ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:51.978568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee318-5ccc-44c1-8be3-2799fcab7ba2 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:52.004434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1185/2363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:51:52.769550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:52.771861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:52.795568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d98f5-aeeb-41bb-b9fe-a82d95b5d238 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:52.805446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:52.806287 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:52.806658 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:52.807037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] PATH_INFO: `/v3/projects/d2ec5acb44444e36a3b95aec9c95389a` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:52.808323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ec5acb44444e36a3b95aec9c95389a)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:52.810774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:53.039262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ec5acb44444e36a3b95aec9c95389a', 'request_id': 'req-c37c2afa-16b3-415b-b489-570deb364ad7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:53.049294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ec5acb44444e36a3b95aec9c95389a', 'request_id': 'req-c37c2afa-16b3-415b-b489-570deb364ad7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:53.069874 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ec5acb44444e36a3b95aec9c95389a', 'request_id': 'req-c37c2afa-16b3-415b-b489-570deb364ad7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:53.152024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] The token cache is being invalidate because project d2ec5acb44444e36a3b95aec9c95389a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:51:53.152322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:53.155071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:51:53.158441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1179/2364] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:51:52 2022] DELETE /identity/v3/projects/d2ec5acb44444e36a3b95aec9c95389a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:51:55.320425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed123a-8d5e-44bd-b5d3-9fc1addfbdc3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:55.321311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed123a-8d5e-44bd-b5d3-9fc1addfbdc3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:55.322547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed123a-8d5e-44bd-b5d3-9fc1addfbdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:55.349345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-49ed123a-8d5e-44bd-b5d3-9fc1addfbdc3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:51:55.350769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-49ed123a-8d5e-44bd-b5d3-9fc1addfbdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:55.435500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1186/2365] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:51:55.458669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:51:55.460097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:51:55.561464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c2afa-16b3-415b-b489-570deb364ad7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:51:55.569071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:51:55.569711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:51:55.570031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:51:55.570300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:51:55.579459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:51:55.581064 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:51:55.592004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1180/2366] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:01.792629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696d2e4-bb6f-428a-bbb3-da3c873c3657 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:01.793223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696d2e4-bb6f-428a-bbb3-da3c873c3657 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:01.793223 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2696d2e4-bb6f-428a-bbb3-da3c873c3657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:01.814133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2696d2e4-bb6f-428a-bbb3-da3c873c3657 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:01.815332 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2696d2e4-bb6f-428a-bbb3-da3c873c3657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:01.824113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1187/2367] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:01.852375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:01.864370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fe0af-3427-4cac-b697-b96f4497845a service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:01.871348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785bbe9-36d6-4fe8-8c5a-35bd71ab0de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:01.877351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785bbe9-36d6-4fe8-8c5a-35bd71ab0de5 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:01.877351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785bbe9-36d6-4fe8-8c5a-35bd71ab0de5 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:01.877351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785bbe9-36d6-4fe8-8c5a-35bd71ab0de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:01.881994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785bbe9-36d6-4fe8-8c5a-35bd71ab0de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:01.883839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785bbe9-36d6-4fe8-8c5a-35bd71ab0de5 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:01.894786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1181/2368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:02.388889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3fcb8-3047-4df5-8440-839fb74c821f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:02.389199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3fcb8-3047-4df5-8440-839fb74c821f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:02.389552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3fcb8-3047-4df5-8440-839fb74c821f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:02.415626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c0b3fcb8-3047-4df5-8440-839fb74c821f None None] MFA Rules not processed for user `1ebddb80fdb4411886e6204715a10e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:02.416858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c0b3fcb8-3047-4df5-8440-839fb74c821f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:02.448728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:02.475743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1188/2369] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:52:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:03.146386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228e24a-8527-4fd2-8fb4-47418cb82680 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.147425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228e24a-8527-4fd2-8fb4-47418cb82680 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.147425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228e24a-8527-4fd2-8fb4-47418cb82680 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.149075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1182/2370] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:52:03.155451 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc7dd9-3b73-4df9-ab23-688314ec7f31 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.155972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc7dd9-3b73-4df9-ab23-688314ec7f31 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.157163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc7dd9-3b73-4df9-ab23-688314ec7f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.182008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7efc7dd9-3b73-4df9-ab23-688314ec7f31 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:03.185367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7efc7dd9-3b73-4df9-ab23-688314ec7f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:03.198516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1189/2371] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:52:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:03.211284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228e24a-8527-4fd2-8fb4-47418cb82680 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:03.213246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a228e24a-8527-4fd2-8fb4-47418cb82680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:03.227423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:03.282141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228e24a-8527-4fd2-8fb4-47418cb82680 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:03.286077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c9cda-c2fa-49c7-85aa-2a5be67d8fb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:03.286623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9cda-c2fa-49c7-85aa-2a5be67d8fb0 service glance] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.286934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9cda-c2fa-49c7-85aa-2a5be67d8fb0 service glance] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.287208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9cda-c2fa-49c7-85aa-2a5be67d8fb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.297390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c9cda-c2fa-49c7-85aa-2a5be67d8fb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:03.299032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c9cda-c2fa-49c7-85aa-2a5be67d8fb0 service glance] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:03.311527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1183/2372] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:03.523651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6824b65-03cb-46ce-b23e-d0fd3331b982 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.523966 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6824b65-03cb-46ce-b23e-d0fd3331b982 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.524300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6824b65-03cb-46ce-b23e-d0fd3331b982 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.525737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1190/2373] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:52:03.530417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443fc4e-609d-42d9-a388-329c6856529d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.530709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443fc4e-609d-42d9-a388-329c6856529d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.530987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443fc4e-609d-42d9-a388-329c6856529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.551574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3443fc4e-609d-42d9-a388-329c6856529d None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:03.553311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3443fc4e-609d-42d9-a388-329c6856529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:03.607457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1184/2374] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:52:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:03.619938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6824b65-03cb-46ce-b23e-d0fd3331b982 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:03.622203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b6824b65-03cb-46ce-b23e-d0fd3331b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:03.635988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6824b65-03cb-46ce-b23e-d0fd3331b982 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:03.639617 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2c0fd-4439-4c41-99b2-f653640ed726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:03.640222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c0fd-4439-4c41-99b2-f653640ed726 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.640503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c0fd-4439-4c41-99b2-f653640ed726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.640777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2c0fd-4439-4c41-99b2-f653640ed726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.647898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c0fd-4439-4c41-99b2-f653640ed726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:03.649418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2c0fd-4439-4c41-99b2-f653640ed726 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:03.657265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1191/2375] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:03.742914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99940f-a838-4a2b-99fd-c4055ba323f3 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.743203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99940f-a838-4a2b-99fd-c4055ba323f3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.743545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99940f-a838-4a2b-99fd-c4055ba323f3 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.744858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1185/2376] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:52:03.751325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229646-2210-4c65-87f4-010cf7e07444 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.757245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229646-2210-4c65-87f4-010cf7e07444 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.757245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e229646-2210-4c65-87f4-010cf7e07444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.772464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4e229646-2210-4c65-87f4-010cf7e07444 None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:03.773659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4e229646-2210-4c65-87f4-010cf7e07444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:03.783480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1192/2377] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:52:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:03.794723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99940f-a838-4a2b-99fd-c4055ba323f3 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:03.811520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99940f-a838-4a2b-99fd-c4055ba323f3 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:03.815679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:03.816353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:03.816732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:03.817091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:03.828268 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:03.829704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:03.840835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1186/2378] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:52:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:52:06.946164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac5bf4-c899-469f-85ad-f4ef2ebc20b5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:06.946667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac5bf4-c899-469f-85ad-f4ef2ebc20b5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:06.946764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac5bf4-c899-469f-85ad-f4ef2ebc20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:06.968676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bfac5bf4-c899-469f-85ad-f4ef2ebc20b5 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:06.969991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bfac5bf4-c899-469f-85ad-f4ef2ebc20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:07.038202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1193/2379] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:52:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:07.054252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:07.054252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:07.124224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb11231-d91e-4cf1-a076-df034b4c7c8d service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:07.129319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:07.129986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:07.130269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:07.130546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:07.151877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:07.151877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:07.161337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1187/2380] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:52:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:17.031295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=47 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:17.157019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=83 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:25.242732 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:25.243262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:25.243470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:25.265187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:52:25.266438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:52:25.274129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1194/2381] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:52:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:52:25.287681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:52:25.303428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7abafe-495b-4f2d-b373-9ae62fe7995e service swift] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:52:25.311479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719903b4-4a78-4048-8743-8db2366cfa61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:52:25.312087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719903b4-4a78-4048-8743-8db2366cfa61 service swift] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:52:25.312372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719903b4-4a78-4048-8743-8db2366cfa61 service swift] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:52:25.312650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719903b4-4a78-4048-8743-8db2366cfa61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:52:25.322389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719903b4-4a78-4048-8743-8db2366cfa61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:52:25.323992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719903b4-4a78-4048-8743-8db2366cfa61 service swift] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:52:25.333132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1188/2382] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:52:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:52:35.259992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:52:35.330124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:02.995251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:02.997350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:03.008991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b351a-3b5f-4af8-a774-eeff859a9977 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:03.012660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:03.013258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:03.013533 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:03.013825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:03.015524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:03.028809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:03.030358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:03.042553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1195/2383] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:03.433123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:03.437809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:03.437809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:03.453066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:03.454319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:03.461897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1189/2384] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 24 03:53:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:03.485220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:03.496799 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c518e66-073d-425f-8f02-3f41de36307d service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:03.502031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573793b0-a7eb-4b65-846d-2738f34a35d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:03.502656 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573793b0-a7eb-4b65-846d-2738f34a35d4 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:03.506590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573793b0-a7eb-4b65-846d-2738f34a35d4 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:03.506590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573793b0-a7eb-4b65-846d-2738f34a35d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:03.512535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573793b0-a7eb-4b65-846d-2738f34a35d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:03.514181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573793b0-a7eb-4b65-846d-2738f34a35d4 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:03.526063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1196/2385] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:53:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:53:04.882379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:04.897408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427f75a-be82-4d4a-81b7-8fc9f23209c7 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:04.903524 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:04.904125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:04.904402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:04.904672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:04.906559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:04.973405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:04.975136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:04.985522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1190/2386] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:06.812964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:06.813552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:06.813552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:06.832918 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] MFA Rules not processed for user `1ad3dce1516c4163af39a94c63679ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:06.834193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:06.889288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1197/2387] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:07.127957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:07.139075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e833-1e86-4f87-ade9-7119cc7b0697 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:07.143075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:07.143764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:07.144219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:07.144496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:07.146307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:07.156994 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:07.158479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:07.167094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1191/2388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:07.590014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:07.591726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:07.596171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:07.607702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede022d2-fc62-4ff7-81c4-4e08f9413392 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:07.611379 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:07.611990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:07.612273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:07.612545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:07.614396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:07.630296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:07.631731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:07.643220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1192/2389] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:53:07.667278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11740178-b8f2-4f2a-90a9-35102a5cfe26 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:07.674068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:07.674735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:07.675043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:07.675301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:07.677091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:07.689910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:07.691541 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:07.706388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1198/2390] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:09.100325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:09.109833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a694571-78d1-4c36-9195-1fcef42b2351 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:09.113620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:09.114452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:09.114821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:09.115165 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:09.117061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:09.181926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:09.183360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:09.193736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1193/2391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:16.727907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:16.737742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3136-eb2e-4ff8-9ec5-5a57961f7d03 service placement] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:16.741445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:16.742083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:16.742363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:16.742633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:16.744345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:16.754467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:16.755955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14990125-9f3d-4334-8968-89dc25a2bf52 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:16.764570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1199/2392] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:17.622787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:17.624294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:17.639791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e486-d1e7-4230-8440-907d5bf125d5 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:17.645402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:17.646045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:17.646330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:17.646602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:17.648337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:17.712861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:17.715311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:17.719903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:17.726967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1194/2393] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:26.760741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=75 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:27.780817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:29.567280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df886f9d-cc40-4811-a8c2-83f7838d67a2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:29.567916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df886f9d-cc40-4811-a8c2-83f7838d67a2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:29.567916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df886f9d-cc40-4811-a8c2-83f7838d67a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:29.589091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-df886f9d-cc40-4811-a8c2-83f7838d67a2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:29.590383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-df886f9d-cc40-4811-a8c2-83f7838d67a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:29.599304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1200/2394] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:29.626750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:29.638691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f28f9f9-b088-45b4-b1ed-911f2bea5346 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:29.644388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:29.645000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:29.645279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:29.645551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:29.654308 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:29.655886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:29.666324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1195/2395] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:37.184372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af342eb-6020-4ad4-b248-0d3e38b4f973 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:37.185545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af342eb-6020-4ad4-b248-0d3e38b4f973 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:37.185545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af342eb-6020-4ad4-b248-0d3e38b4f973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:37.206436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4af342eb-6020-4ad4-b248-0d3e38b4f973 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:37.207676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4af342eb-6020-4ad4-b248-0d3e38b4f973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:37.215904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1201/2396] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:37.263956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:37.275372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7a8e8-a2ae-48ee-84b9-7759f51ec77f service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:37.281107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:37.281716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:37.282026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:37.282303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:37.291109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:37.292751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:37.303446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1196/2397] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:40.215866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecb0a-487f-4da7-8647-d81819833922 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.216395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecb0a-487f-4da7-8647-d81819833922 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.216395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecb0a-487f-4da7-8647-d81819833922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.235171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bc0ecb0a-487f-4da7-8647-d81819833922 None None] MFA Rules not processed for user `a7a6eb1ae2eb4110b6bd689740769aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:40.236379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bc0ecb0a-487f-4da7-8647-d81819833922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:40.243220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1202/2398] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:40.567443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:40.577093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1e54-da26-4556-a63e-68b3df9db917 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:40.580717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:40.581311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:40.581588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:40.581895 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:40.583673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:40.594029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:40.595447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:40.603316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1197/2399] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:42.122311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b23d4-c9a1-4b85-a93c-21ca7f38460d None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:42.123185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b23d4-c9a1-4b85-a93c-21ca7f38460d None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:42.123626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b23d4-c9a1-4b85-a93c-21ca7f38460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:42.146264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ce7b23d4-c9a1-4b85-a93c-21ca7f38460d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:42.147474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ce7b23d4-c9a1-4b85-a93c-21ca7f38460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:42.156018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1203/2400] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:42.177810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:42.191400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2415c9-3bb8-4c31-ac50-ff06b274659c service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:42.196954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:42.197554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:42.197866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:42.198145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:42.207041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:42.208629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:42.218306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1198/2401] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:47.409444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:47.410018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:47.410018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:47.430100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:47.431323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:47.439968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1204/2402] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:47.466531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:47.478086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a7623d-b91b-45a8-93ae-4784327fc3e1 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:47.483811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0ae37-fa61-42c3-b990-f22c910f4901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:47.484420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0ae37-fa61-42c3-b990-f22c910f4901 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:47.484708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0ae37-fa61-42c3-b990-f22c910f4901 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:47.485028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0ae37-fa61-42c3-b990-f22c910f4901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:47.493925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0ae37-fa61-42c3-b990-f22c910f4901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:47.495505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0ae37-fa61-42c3-b990-f22c910f4901 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:47.505386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1199/2403] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:48.462535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:48.478768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece06c2-2c4b-49fd-ad38-c35b1c2c4068 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:48.484842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:48.487576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:48.487576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:48.487576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:48.487965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:48.500596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:48.502281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:48.514349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1205/2404] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:56.803175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:56.803711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:56.803827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:56.823907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:53:56.825614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:56.833857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1200/2405] 10.222.0.95 () {58 vars in 1016 bytes} [Wed Aug 24 03:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:53:56.856868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:56.862817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=22 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:56.868985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d93f5-580d-4111-b272-8473888085cd service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:56.874616 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:56.875272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:56.875555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:56.875831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:56.884186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:56.885813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:56.896362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1206/2406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:53:58.301999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:53:58.308958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=34 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:53:58.320439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a98bb-9986-42ee-9232-1c6048a962aa None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:53:58.321476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:53:58.322110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:53:58.322391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:53:58.322661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:53:58.324376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:53:58.336603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:53:58.338224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438b6e59-5aed-4177-9bf1-91dd837e236a service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:53:58.348896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1201/2407] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:53:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:04.514402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:04.525781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a824a7-5e42-4781-8d3b-35ae1df96f51 service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:04.534117 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:04.534750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:04.535031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:04.535303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:04.537473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:04.556359 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:04.558002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:04.570067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1207/2408] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:08.431093 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:14.565030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=11 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:14.697529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16952d-9595-4f20-adcc-7b6e5dc2eb68 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:14.698091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16952d-9595-4f20-adcc-7b6e5dc2eb68 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:14.698091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16952d-9595-4f20-adcc-7b6e5dc2eb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:14.719091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-3f16952d-9595-4f20-adcc-7b6e5dc2eb68 None None] MFA Rules not processed for user `dd8808dab1914b269a80addf376bab0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:14.720306 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3f16952d-9595-4f20-adcc-7b6e5dc2eb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:14.775599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1202/2409] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:54:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:24.768677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=25 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:26.328216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:26.339615 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1000561-19c4-456f-a958-9f2ea736dbb1 service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:26.345997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:26.346612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:26.346896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:26.347858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:26.349419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:26.412251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:26.416647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:26.424667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1208/2410] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:54:36.420201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=28 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:37.228025 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:37.228556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:37.228556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:37.247878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] MFA Rules not processed for user `790de0d0a3954663b4f2f140517b5ca5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:54:37.249013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:37.256143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1203/2411] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:54:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:54:38.784972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:38.786682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.845268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23306b-e7df-400f-91dd-49825fcf80e6 service nova] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:38.854618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:38.855238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:38.855517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:38.855791 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:38.857621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:38.869968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:38.871409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:38.881324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1209/2412] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:42.911793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:42.928425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe0423-83ff-47aa-bf5d-fb97f4ec0b69 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:42.934189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:42.934811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:42.935100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:42.935376 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:42.937305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:42.950150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:42.952208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:42.962561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1204/2413] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:54:43.582841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:43.584341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:54:43.599457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcadbd4-8cc0-4e3a-ae44-b4c74e5cefdf service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:43.604261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:43.604904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:43.605182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:43.605455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] PATH_INFO: `/v3/users/1ad3dce1516c4163af39a94c63679ac5` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:43.606620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad3dce1516c4163af39a94c63679ac5)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:43.613576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:43.741632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad3dce1516c4163af39a94c63679ac5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:43.742408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad3dce1516c4163af39a94c63679ac5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:43.743002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad3dce1516c4163af39a94c63679ac5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:43.755865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad3dce1516c4163af39a94c63679ac5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:43.801964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a635c082-6902-4c86-b2cf-d7526868a6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad3dce1516c4163af39a94c63679ac5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:43.816010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1210/2414] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:54:43 2022] DELETE /identity/v3/users/1ad3dce1516c4163af39a94c63679ac5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:44.072418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:54:44.084640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc3f1a-cfc1-42d5-ad2d-c62590567821 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:54:44.143846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:54:44.144483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:54:44.144766 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:54:44.145066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] PATH_INFO: `/v3/projects/215eb7dafffe499fad6075b84bc609d3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:54:44.146221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=215eb7dafffe499fad6075b84bc609d3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:54:44.148123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:54:44.282727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215eb7dafffe499fad6075b84bc609d3', 'request_id': 'req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:44.289260 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215eb7dafffe499fad6075b84bc609d3', 'request_id': 'req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:44.294929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215eb7dafffe499fad6075b84bc609d3', 'request_id': 'req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:44.373357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] The token cache is being invalidate because project 215eb7dafffe499fad6075b84bc609d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:54:44.373592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:44.374227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:54:44.375796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1205/2415] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:54:44 2022] DELETE /identity/v3/projects/215eb7dafffe499fad6075b84bc609d3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:54:53.812035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:54:54.369482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:04.531271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:04.531271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:04.531271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:04.551132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] MFA Rules not processed for user `68eff070a8eb4497af4e8ed2b5110405`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:55:04.552344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:04.608485 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1211/2416] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:55:14.601044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=25 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:38.402607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:38.404066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:38.462721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a4084-8f8f-4b88-9ee1-6d3ace9d8352 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:38.466410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:38.467965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:38.467965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:38.467965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:38.469579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:38.528543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:38.529990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:38.539880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1206/2417] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:55:48.535333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=48 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:55:55.546682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:55:55.548119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.695169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8d1af-9728-4e4e-9b1b-bd07b8f8a273 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:55:55.700322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:55:55.700927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:55:55.701224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:55:55.701495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:55:55.703271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:55:55.714584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:55:55.716171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:55:55.726175 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1212/2418] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:55:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:05.584507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:05.586991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:05.698714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2a593-e18c-4c6c-9269-0350105e38f1 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:05.702420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:05.703112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:05.703584 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:05.703867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:05.705633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:05.721678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=63 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:05.804348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:05.806384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:05.836981 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1207/2419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:10.166840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:10.168664 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.182322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83252a24-dbd1-4215-8480-d58e8f2f21d6 service placement] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:10.188302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:10.188946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.189232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.189505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.191302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.210850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:10.210850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a71d5-0953-4335-8e87-ad1358fdd9fa service placement] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:10.216368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1213/2420] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:10.346284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:10.347873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:10.360219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9f63e-0467-4f22-a1b7-98ecceaaa681 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:10.365523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:10.366241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.366523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.366799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] PATH_INFO: `/v3/users/dd8808dab1914b269a80addf376bab0c` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.368014 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8808dab1914b269a80addf376bab0c)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:10.370049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:10.584647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:10.593469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8808dab1914b269a80addf376bab0c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.594199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8808dab1914b269a80addf376bab0c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.594812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8808dab1914b269a80addf376bab0c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.607615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8808dab1914b269a80addf376bab0c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.715610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8808dab1914b269a80addf376bab0c'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:10.729609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1208/2421] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:10 2022] DELETE /identity/v3/users/dd8808dab1914b269a80addf376bab0c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:10.974951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904bf9-1457-40a6-ab5c-7ca735229a68 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:10.975241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904bf9-1457-40a6-ab5c-7ca735229a68 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:10.975515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34904bf9-1457-40a6-ab5c-7ca735229a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:10.994738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-34904bf9-1457-40a6-ab5c-7ca735229a68 None None] MFA Rules not processed for user `a7a6eb1ae2eb4110b6bd689740769aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:10.995873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-34904bf9-1457-40a6-ab5c-7ca735229a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.053199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1214/2422] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:11.154651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.157747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.245420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f592b3f-479f-4128-9833-f03662018aba admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.251507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.252293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.252581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.252876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] PATH_INFO: `/v3/projects/b8e2111317f44f828a0bbcca6db7e109` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.254075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e2111317f44f828a0bbcca6db7e109)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.256560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.384526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e2111317f44f828a0bbcca6db7e109', 'request_id': 'req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.391824 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e2111317f44f828a0bbcca6db7e109', 'request_id': 'req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.397749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e2111317f44f828a0bbcca6db7e109', 'request_id': 'req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.471183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] The token cache is being invalidate because project b8e2111317f44f828a0bbcca6db7e109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:11.471183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.474544 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e52bb481-774b-4ed0-a0f5-e9e3d1005caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:11.476127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1209/2423] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:11 2022] DELETE /identity/v3/projects/b8e2111317f44f828a0bbcca6db7e109 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:11.481031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.481481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.481587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.540690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:11.541937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.608433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1215/2424] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:11.617362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.617736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.618132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.638818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:11.640208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:11.649967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1210/2425] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:11.657889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.668316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077d7e3-99c5-4add-b26c-8611c197960f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.672986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.673596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.673906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.674183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.674840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:11.675143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.676783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.689348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1216/2426] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:11.693816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.703167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa9185-5902-496f-8fdd-19c78cd91f50 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:11.708585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:11.709183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:11.709462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:11.709732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:11.710390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:11.712286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:11.925910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1211/2427] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/projects => generated 405 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:11.927734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:11.939240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3dc55c-293a-4d1c-b73d-420530b9abb6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.001339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.016989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.018009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.018009 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.018394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.019086 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.021287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.148776 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1217/2428] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:11 2022] POST /identity/v3/users => generated 303 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:12.153037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.163811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c58b-bac4-4c08-888e-9f82a0be9b00 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.168632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.169223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.169512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.169810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.170503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.172631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.186175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1212/2429] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:12.194859 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.198581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb80f44-d469-47a3-9023-524dd0bd92f2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.203198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb74972-d01a-4ca1-8508-ea0c8e7215fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.203798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74972-d01a-4ca1-8508-ea0c8e7215fd admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.204130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74972-d01a-4ca1-8508-ea0c8e7215fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.204399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb74972-d01a-4ca1-8508-ea0c8e7215fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.205039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb74972-d01a-4ca1-8508-ea0c8e7215fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.206665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb74972-d01a-4ca1-8508-ea0c8e7215fd admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.217631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1218/2430] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:12.221949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.228537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:12.232816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1b4b0-7f67-42cc-9df4-6ac2504b4409 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.239716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.240402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.240681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.240953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] PATH_INFO: `/v3/projects/d388cc4fa5c04ca7bec166477b52ed5e/users/1fdfb95c3fc645f3accb5c3a7a5fb6b6/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.258391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d388cc4fa5c04ca7bec166477b52ed5e, user_id=1fdfb95c3fc645f3accb5c3a7a5fb6b6, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.261364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.471168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1213/2431] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:12 2022] PUT /identity/v3/projects/d388cc4fa5c04ca7bec166477b52ed5e/users/1fdfb95c3fc645f3accb5c3a7a5fb6b6/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:12.481582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.482076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.482344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.511487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] MFA Rules not processed for user `1fdfb95c3fc645f3accb5c3a7a5fb6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:12.512756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:12.579063 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1219/2432] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:12.583600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.661957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a611f0-23a1-48aa-8261-a3923f8e2748 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.666891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.667530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.667809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.668079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.668709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.670664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:12.775307 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1214/2433] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/projects => generated 403 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:12.779626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:12.792013 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be12fd0-782e-4473-9792-a3bc5ee3fb67 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:12.850236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:12.850854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:12.851138 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:12.851447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:12.852084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:12.854036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.024394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1220/2434] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:12 2022] POST /identity/v3/users => generated 308 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:13.024509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.034494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b706a-77b6-49f5-a567-92d0f63fb0c5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.041459 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.043122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.043122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.043580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.044312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.046374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.060865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1215/2435] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:13.065563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.075922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c83a1-d964-4565-91bd-ba6411425ee9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.082172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.083049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.083333 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.083612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] PATH_INFO: `/v3/projects/55f0c1283b3d4c8a9162779cb98b5a54/users/f394c2f0a4f94fa0b9c86916a55710d1/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.104681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f0c1283b3d4c8a9162779cb98b5a54, user_id=f394c2f0a4f94fa0b9c86916a55710d1, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.104681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.230891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1221/2436] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:13 2022] PUT /identity/v3/projects/55f0c1283b3d4c8a9162779cb98b5a54/users/f394c2f0a4f94fa0b9c86916a55710d1/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:13.242286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.253627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd90ab9-7516-40cf-bac0-71333d7e3185 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.309705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf3d4-cf65-4f50-b3a9-120f524984bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.309705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf3d4-cf65-4f50-b3a9-120f524984bf admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.310019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf3d4-cf65-4f50-b3a9-120f524984bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.310293 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf3d4-cf65-4f50-b3a9-120f524984bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.310937 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf3d4-cf65-4f50-b3a9-120f524984bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.313504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf3d4-cf65-4f50-b3a9-120f524984bf admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.324369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1216/2437] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:13.329717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.341139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb443-bafe-4a1b-af28-8fc717bd6eb7 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.346679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.347353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.347634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.347907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] PATH_INFO: `/v3/projects/55f0c1283b3d4c8a9162779cb98b5a54/users/f394c2f0a4f94fa0b9c86916a55710d1/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.349930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f0c1283b3d4c8a9162779cb98b5a54, user_id=f394c2f0a4f94fa0b9c86916a55710d1, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.352593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.364122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1222/2438] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:13 2022] PUT /identity/v3/projects/55f0c1283b3d4c8a9162779cb98b5a54/users/f394c2f0a4f94fa0b9c86916a55710d1/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:13.374517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.377548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.377548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.406359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] MFA Rules not processed for user `f394c2f0a4f94fa0b9c86916a55710d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:13.407422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.447549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.475566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1217/2439] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:13.486812 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.488653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:13.503331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:13.571728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c43993-7831-4241-a25a-0d6ee094e91d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.575452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d191c3-4b29-4000-b6fa-e864117fab51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.576059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d191c3-4b29-4000-b6fa-e864117fab51 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.576368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d191c3-4b29-4000-b6fa-e864117fab51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.576645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d191c3-4b29-4000-b6fa-e864117fab51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.589030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d191c3-4b29-4000-b6fa-e864117fab51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.591858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d191c3-4b29-4000-b6fa-e864117fab51 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:13.606524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1223/2440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:13.756772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:13.819367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe3c8a-790c-4d03-b3fa-760e7796ed13 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:13.823972 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:13.824544 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:13.824876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:13.825142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] PATH_INFO: `/v3/users/1fdfb95c3fc645f3accb5c3a7a5fb6b6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:13.826439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fdfb95c3fc645f3accb5c3a7a5fb6b6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:13.828533 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.130592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fdfb95c3fc645f3accb5c3a7a5fb6b6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.131473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fdfb95c3fc645f3accb5c3a7a5fb6b6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.132089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fdfb95c3fc645f3accb5c3a7a5fb6b6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.145535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fdfb95c3fc645f3accb5c3a7a5fb6b6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.246992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fdfb95c3fc645f3accb5c3a7a5fb6b6'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:14.260274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1218/2441] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:13 2022] DELETE /identity/v3/users/1fdfb95c3fc645f3accb5c3a7a5fb6b6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:14.264915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.265203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.265480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.285334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:14.286585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.345725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1224/2442] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:14.355855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:14.357366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:14.419512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb91fbe-dd75-4fc6-b7dc-eeedf52ca7ed admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:14.423124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:14.423728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:14.424006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:14.424274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:14.433342 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:14.434830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:14.438858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:14.445169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1219/2443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:15.199598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.201343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:15.236141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebef07-354f-4a3e-af9d-b85810d217fa None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.245939 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.246708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.247839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.248306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] PATH_INFO: `/v3/projects/d388cc4fa5c04ca7bec166477b52ed5e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.249649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d388cc4fa5c04ca7bec166477b52ed5e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.253484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:15.551259 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd388cc4fa5c04ca7bec166477b52ed5e', 'request_id': 'req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.557480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd388cc4fa5c04ca7bec166477b52ed5e', 'request_id': 'req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.674658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd388cc4fa5c04ca7bec166477b52ed5e', 'request_id': 'req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.689339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] The token cache is being invalidate because project d388cc4fa5c04ca7bec166477b52ed5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:15.689673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.690344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:15.692253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1225/2444] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:15 2022] DELETE /identity/v3/projects/d388cc4fa5c04ca7bec166477b52ed5e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:15.696110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:15.706187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cdac7-f4e9-44cc-b79b-182a03ba9ad1 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:15.767032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:15.767681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:15.767959 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:15.768228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] PATH_INFO: `/v3/users/f394c2f0a4f94fa0b9c86916a55710d1` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:15.769680 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f394c2f0a4f94fa0b9c86916a55710d1)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:15.771812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:16.040897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f394c2f0a4f94fa0b9c86916a55710d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.041619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f394c2f0a4f94fa0b9c86916a55710d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.042323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f394c2f0a4f94fa0b9c86916a55710d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.055853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f394c2f0a4f94fa0b9c86916a55710d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.207557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3a366e7e-a35e-4472-9324-59b894336651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f394c2f0a4f94fa0b9c86916a55710d1'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:16.227358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1220/2445] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:15 2022] DELETE /identity/v3/users/f394c2f0a4f94fa0b9c86916a55710d1 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:16.786254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:16.789997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:16.822955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea1d6d-ff05-4b77-b9cb-1cc05dc69fc1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:16.839181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:16.888304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:16.888953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:16.889236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:16.889515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] PATH_INFO: `/v3/projects/55f0c1283b3d4c8a9162779cb98b5a54` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:16.890696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f0c1283b3d4c8a9162779cb98b5a54)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:16.892648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.034579 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f0c1283b3d4c8a9162779cb98b5a54', 'request_id': 'req-2525f498-7b81-4794-9fb3-a556d9d423eb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.043289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f0c1283b3d4c8a9162779cb98b5a54', 'request_id': 'req-2525f498-7b81-4794-9fb3-a556d9d423eb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.146771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f0c1283b3d4c8a9162779cb98b5a54', 'request_id': 'req-2525f498-7b81-4794-9fb3-a556d9d423eb'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.168996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] The token cache is being invalidate because project 55f0c1283b3d4c8a9162779cb98b5a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:17.169735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.179899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2525f498-7b81-4794-9fb3-a556d9d423eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:17.179899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1226/2446] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:16 2022] DELETE /identity/v3/projects/55f0c1283b3d4c8a9162779cb98b5a54 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:17.180999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359934-5406-490b-97e1-b565745470a8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.181737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359934-5406-490b-97e1-b565745470a8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.181979 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f359934-5406-490b-97e1-b565745470a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.206823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-0f359934-5406-490b-97e1-b565745470a8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:17.208661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0f359934-5406-490b-97e1-b565745470a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.273912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1221/2447] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:17.283593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.283885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.284412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.305941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:17.306530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.315498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1227/2448] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:17.319460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359934-5406-490b-97e1-b565745470a8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.330661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f359934-5406-490b-97e1-b565745470a8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.335569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.336176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.336452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.336721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.337400 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:17.337696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.339318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.352409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1222/2449] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:56:17.356931 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.366845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8e0ff-0643-42bd-84d8-2f6390b891fb None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.375416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.376041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.376322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.376591 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.377256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.379241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.499792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1228/2450] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:17.504201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.511296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:17.515742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eefa0-c157-4edb-b6cf-79ed4ba92e13 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.575124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.575657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.575942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.576214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.576845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.578822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.681923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1223/2451] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:17.685969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.696833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54164b07-a015-4928-9d7d-1bfb4f3648a4 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.701862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.702725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.703905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.704357 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.705625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.707303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.721713 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1229/2452] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:17.723086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.733488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98359d-4dce-437a-8070-22887fb74b84 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.738265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3185b-0546-4b3c-a048-b128c52da04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.738909 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3185b-0546-4b3c-a048-b128c52da04a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.739192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3185b-0546-4b3c-a048-b128c52da04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.739466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3185b-0546-4b3c-a048-b128c52da04a admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.740114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3185b-0546-4b3c-a048-b128c52da04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.741719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3185b-0546-4b3c-a048-b128c52da04a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.753265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1224/2453] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:17.757355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:17.768421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2df98-9f7e-42ae-b2de-37dc440858ab admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:17.773398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:17.774188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.774542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.774917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] PATH_INFO: `/v3/projects/18c1dcbfbda64b979b1784072d9b9c28/users/a6274e4dab4245baa4eddff846b7370f/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.791120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c1dcbfbda64b979b1784072d9b9c28, user_id=a6274e4dab4245baa4eddff846b7370f, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:17.793923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:17.861820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1230/2454] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:17 2022] PUT /identity/v3/projects/18c1dcbfbda64b979b1784072d9b9c28/users/a6274e4dab4245baa4eddff846b7370f/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:17.870638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:17.870921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:17.871192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:17.900059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] MFA Rules not processed for user `a6274e4dab4245baa4eddff846b7370f`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:17.901284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:17.972623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1225/2455] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:17.978463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.033904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.051265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550e98b-45d8-4885-a84e-51651e04ca1d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.055997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.056603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.056885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.057164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.057807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.059709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.231707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1231/2456] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:17 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:18.235889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.246709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1eb1d-2914-41c3-9a28-e0b60729bd3a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.306398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.307055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.307341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.307616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.308256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.310196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.412018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1226/2457] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:18.416082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.427094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693ee95-3344-44b9-9f0c-0213839058b7 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.431764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.432442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.432697 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.432982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.433619 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.435320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.446653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1232/2458] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:18.450867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.456235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:18.462078 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e5b4-60a7-4838-881e-d2fb8e9f1abd admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.467036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.467705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.467987 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.468262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] PATH_INFO: `/v3/projects/5cd32b538a79484788122a25b092c3c6/users/c1aaa100a3dc466f8574f02d7037247e/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.484490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd32b538a79484788122a25b092c3c6, user_id=c1aaa100a3dc466f8574f02d7037247e, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.487672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.565383 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1227/2459] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:18 2022] PUT /identity/v3/projects/5cd32b538a79484788122a25b092c3c6/users/c1aaa100a3dc466f8574f02d7037247e/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:18.569502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.579640 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cadc8b-2b50-4830-ba56-91f797709059 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.637535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9fa7a-0d13-4b96-a1eb-c357c9f7fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.638220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9fa7a-0d13-4b96-a1eb-c357c9f7fb76 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.638499 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9fa7a-0d13-4b96-a1eb-c357c9f7fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.638772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9fa7a-0d13-4b96-a1eb-c357c9f7fb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.639477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9fa7a-0d13-4b96-a1eb-c357c9f7fb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.641087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9fa7a-0d13-4b96-a1eb-c357c9f7fb76 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.651232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1233/2460] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:18.655437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.666761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caeecf8-5e58-4f11-820b-f8ddf3cb74c1 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.671717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.672404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.672686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.672963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] PATH_INFO: `/v3/projects/5cd32b538a79484788122a25b092c3c6/users/c1aaa100a3dc466f8574f02d7037247e/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.675528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd32b538a79484788122a25b092c3c6, user_id=c1aaa100a3dc466f8574f02d7037247e, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.678225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.688616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1228/2461] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:18 2022] PUT /identity/v3/projects/5cd32b538a79484788122a25b092c3c6/users/c1aaa100a3dc466f8574f02d7037247e/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:18.699208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b975d8-c413-4269-bddd-db3742431663 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.699484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b975d8-c413-4269-bddd-db3742431663 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.699870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b975d8-c413-4269-bddd-db3742431663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.729480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-00b975d8-c413-4269-bddd-db3742431663 None None] MFA Rules not processed for user `c1aaa100a3dc466f8574f02d7037247e`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:18.730777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-00b975d8-c413-4269-bddd-db3742431663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.804044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1234/2462] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:18.815836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:18.817526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:18.878363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545222f5-8b2f-4042-b116-d14071c3bcde admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:18.883085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:18.883703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:18.883982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:18.884253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:18.894158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:18.895596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:18.905332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1229/2463] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:19.095376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b975d8-c413-4269-bddd-db3742431663 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:19.105564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b975d8-c413-4269-bddd-db3742431663 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:19.109250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5463e-cee4-42d0-a4ee-b8ccb9763252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:19.109869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5463e-cee4-42d0-a4ee-b8ccb9763252 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:19.110146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5463e-cee4-42d0-a4ee-b8ccb9763252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:19.110411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5463e-cee4-42d0-a4ee-b8ccb9763252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:19.145668 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:19.169671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5463e-cee4-42d0-a4ee-b8ccb9763252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:19.170658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5463e-cee4-42d0-a4ee-b8ccb9763252 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:19.180050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1235/2464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:28.901010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=40,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:29.204912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=11 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:31.142556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:31.214351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73f84e-0f43-49b5-9e47-eb992fea4b55 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:31.219235 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:31.219865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:31.220148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:31.220529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] PATH_INFO: `/v3/users/a6274e4dab4245baa4eddff846b7370f` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:31.221545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6274e4dab4245baa4eddff846b7370f)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:31.224394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:31.453858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6274e4dab4245baa4eddff846b7370f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.454447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6274e4dab4245baa4eddff846b7370f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.455060 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6274e4dab4245baa4eddff846b7370f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.467986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6274e4dab4245baa4eddff846b7370f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.581599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6274e4dab4245baa4eddff846b7370f'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:31.596275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1230/2465] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:31 2022] DELETE /identity/v3/users/a6274e4dab4245baa4eddff846b7370f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:31.601255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:31.601760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:31.601919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:31.621170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:31.622503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:31.700790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1236/2466] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:31.711195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:31.712639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:31.772453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070fdb1-2aa0-4437-9925-e24e971fc465 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:31.776015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:31.776638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:31.776918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:31.777188 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:31.786945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:31.788392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:31.798404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1231/2467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:32.297442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:32.298937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:32.312027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614df97b-b1c9-488e-b845-b9fdf7c42bfa None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:32.316814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:32.317507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:32.317813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:32.318090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] PATH_INFO: `/v3/projects/18c1dcbfbda64b979b1784072d9b9c28` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:32.319225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c1dcbfbda64b979b1784072d9b9c28)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:32.321229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:32.448242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c1dcbfbda64b979b1784072d9b9c28', 'request_id': 'req-eb7a2d0a-720d-4775-b432-8c77a9183f58'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.454661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c1dcbfbda64b979b1784072d9b9c28', 'request_id': 'req-eb7a2d0a-720d-4775-b432-8c77a9183f58'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.542261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c1dcbfbda64b979b1784072d9b9c28', 'request_id': 'req-eb7a2d0a-720d-4775-b432-8c77a9183f58'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.553628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] The token cache is being invalidate because project 18c1dcbfbda64b979b1784072d9b9c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:32.554004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.554603 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.556106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1237/2468] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:32 2022] DELETE /identity/v3/projects/18c1dcbfbda64b979b1784072d9b9c28 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:32.560214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:32.570592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478e9b5-380d-4582-9ff2-35765848b55f service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:32.589649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:32.628029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:32.628717 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:32.628999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:32.629277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] PATH_INFO: `/v3/users/c1aaa100a3dc466f8574f02d7037247e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:32.630490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1aaa100a3dc466f8574f02d7037247e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:32.632408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:32.871223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1aaa100a3dc466f8574f02d7037247e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.871891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1aaa100a3dc466f8574f02d7037247e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.872812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1aaa100a3dc466f8574f02d7037247e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.885168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1aaa100a3dc466f8574f02d7037247e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.958667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-982e3bad-25e5-4c6f-a5d0-ebb194e92652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1aaa100a3dc466f8574f02d7037247e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:32.975062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1232/2469] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:32 2022] DELETE /identity/v3/users/c1aaa100a3dc466f8574f02d7037247e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:33.464501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:33.464501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:33.482363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a2d0a-720d-4775-b432-8c77a9183f58 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:33.573538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:33.573538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.573538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.573538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] PATH_INFO: `/v3/projects/5cd32b538a79484788122a25b092c3c6` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.574059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd32b538a79484788122a25b092c3c6)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:33.575959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:33.732129 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:33.749193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd32b538a79484788122a25b092c3c6', 'request_id': 'req-37caaeda-b490-468b-8e99-392c35c4adc0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:33.755511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd32b538a79484788122a25b092c3c6', 'request_id': 'req-37caaeda-b490-468b-8e99-392c35c4adc0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:33.865587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd32b538a79484788122a25b092c3c6', 'request_id': 'req-37caaeda-b490-468b-8e99-392c35c4adc0'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:33.878911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] The token cache is being invalidate because project 5cd32b538a79484788122a25b092c3c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:33.879222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:33.879884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-37caaeda-b490-468b-8e99-392c35c4adc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:33.881693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1238/2470] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:33 2022] DELETE /identity/v3/projects/5cd32b538a79484788122a25b092c3c6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:33.886667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.886667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.887159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:33.917949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:33.919351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:33.989500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1233/2471] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:56:33.997205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da59d1-c56b-489a-8330-821173e23169 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:33.997437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da59d1-c56b-489a-8330-821173e23169 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:33.997729 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da59d1-c56b-489a-8330-821173e23169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.019823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-07da59d1-c56b-489a-8330-821173e23169 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:34.021462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-07da59d1-c56b-489a-8330-821173e23169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.029542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1239/2472] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:34.034298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.045019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c904b6-a58b-4b59-86fa-8442f6f2c61f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.054652 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.055192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.055478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.055746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.056401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:34.056701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.058333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.073162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1234/2473] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:34.078065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da59d1-c56b-489a-8330-821173e23169 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.088443 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da59d1-c56b-489a-8330-821173e23169 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.097079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.097079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.097079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.097079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.098130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.098130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.198287 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1240/2474] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:34.202479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.213114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de82c0-a463-42a0-8ce1-949e1ca4c24c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.244940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:34.278160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.278908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.279290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.279673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.280424 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.282506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.379550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1235/2475] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:34.383271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.395474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93867f-29f2-41cf-98aa-7527c72b425a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.400526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.401134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.401410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.401678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.402452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.404448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.415311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1241/2476] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:34.419393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.429687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523856c-32a7-4609-ad19-85adb759ec67 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.434384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e4a0e-7029-487d-87c8-08e59e2505e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.434982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e4a0e-7029-487d-87c8-08e59e2505e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.435258 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e4a0e-7029-487d-87c8-08e59e2505e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.435528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e4a0e-7029-487d-87c8-08e59e2505e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.436160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e4a0e-7029-487d-87c8-08e59e2505e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.437742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e4a0e-7029-487d-87c8-08e59e2505e0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.449700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1236/2477] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:34.453945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.464803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656f7d9-da48-495a-80d3-47beacb8a141 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.469550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.470258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.470538 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.470817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] PATH_INFO: `/v3/projects/2936003cc4fb4ff9931b961886bc7cb2/users/0a5c16d5f5b44b98acd51648a7a14445/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.486374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2936003cc4fb4ff9931b961886bc7cb2, user_id=0a5c16d5f5b44b98acd51648a7a14445, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.489075 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.631457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1242/2478] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:34 2022] PUT /identity/v3/projects/2936003cc4fb4ff9931b961886bc7cb2/users/0a5c16d5f5b44b98acd51648a7a14445/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:34.644042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.648410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.648410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.673529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] MFA Rules not processed for user `0a5c16d5f5b44b98acd51648a7a14445`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:34.674818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:34.742876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1237/2479] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:34.747306 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.810178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca56c0-f93b-4d4d-826c-7dd4c7531eba admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:34.814950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:34.815554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:34.815976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:34.816255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:34.816915 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:34.818867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:34.934722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1243/2480] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/projects => generated 363 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:34.938230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:34.949206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fae42-215a-435f-92cc-9821fd1efba4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.008478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.009139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.009421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.009701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.010371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.012316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.168142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1238/2481] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:34 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:56:35.175567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.182920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4a677-1f94-4ed0-9760-a6e66bb12e0b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.187658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.188269 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.188539 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.188872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.189593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.191727 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.205810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1244/2482] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:56:35.209499 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.220644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707fdb3-5b88-47cc-a2be-e4204f40c745 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.225580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.226361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.226830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.227180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] PATH_INFO: `/v3/projects/02fa2a6c211d4d3ab8c3f0db23e314c2/users/ce489d7c3dae4aa2b686872e2083989b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.244474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fa2a6c211d4d3ab8c3f0db23e314c2, user_id=ce489d7c3dae4aa2b686872e2083989b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.247243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.361353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1239/2483] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:35 2022] PUT /identity/v3/projects/02fa2a6c211d4d3ab8c3f0db23e314c2/users/ce489d7c3dae4aa2b686872e2083989b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:35.365618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.375804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e94eb-f253-466e-9559-ce7212633e1b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.396528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:35.432236 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e534-1a92-4a34-a987-717d165c79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.432847 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e534-1a92-4a34-a987-717d165c79bf admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.433128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e534-1a92-4a34-a987-717d165c79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.433404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e534-1a92-4a34-a987-717d165c79bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.434165 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e534-1a92-4a34-a987-717d165c79bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.435706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e534-1a92-4a34-a987-717d165c79bf admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.445895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1245/2484] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:35.450056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.455698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:35.461804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431f3b3-bc09-4f6d-b595-a7ae69e31c5f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.466568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.467284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.467514 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.467790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] PATH_INFO: `/v3/projects/02fa2a6c211d4d3ab8c3f0db23e314c2/users/ce489d7c3dae4aa2b686872e2083989b/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.469716 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] RBAC: Authorizing `identity:create_grant(project_id=02fa2a6c211d4d3ab8c3f0db23e314c2, user_id=ce489d7c3dae4aa2b686872e2083989b, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.472421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.483024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1240/2485] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:35 2022] PUT /identity/v3/projects/02fa2a6c211d4d3ab8c3f0db23e314c2/users/ce489d7c3dae4aa2b686872e2083989b/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:35.496454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991e48-e2cd-45ba-9f20-bd0ba6ee65ce None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.496454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991e48-e2cd-45ba-9f20-bd0ba6ee65ce None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.496454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991e48-e2cd-45ba-9f20-bd0ba6ee65ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.524637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bc991e48-e2cd-45ba-9f20-bd0ba6ee65ce None None] MFA Rules not processed for user `ce489d7c3dae4aa2b686872e2083989b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:35.525952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bc991e48-e2cd-45ba-9f20-bd0ba6ee65ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.594833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1246/2486] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:35.607522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:35.609255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:35.667225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04a970-26b3-4ea9-8b4b-a7bb410b45de admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:35.671232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:35.671898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.672111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.672381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.681249 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:35.682703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:35.692013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1241/2487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:35.939449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:35.939735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:35.940012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:35.972682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:35.973987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.041992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1247/2488] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 24 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:36.227281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.228906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:36.304303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba44080-2efe-44df-b660-00b9c7348528 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.309865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92497063-0847-4d0e-8b85-8bcbb1560507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.310479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497063-0847-4d0e-8b85-8bcbb1560507 service swift] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.310835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497063-0847-4d0e-8b85-8bcbb1560507 service swift] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.311112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92497063-0847-4d0e-8b85-8bcbb1560507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.320704 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497063-0847-4d0e-8b85-8bcbb1560507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.322359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92497063-0847-4d0e-8b85-8bcbb1560507 service swift] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:36.331539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1242/2489] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:56:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:56:36.724764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:36.766506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:36.791871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a778d-a8e1-433d-9896-342327684d5a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:36.796471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:36.797111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:36.797393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:36.797676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] PATH_INFO: `/v3/users/0a5c16d5f5b44b98acd51648a7a14445` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:36.798861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5c16d5f5b44b98acd51648a7a14445)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:36.801498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.132497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5c16d5f5b44b98acd51648a7a14445'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.133137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5c16d5f5b44b98acd51648a7a14445'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.133807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5c16d5f5b44b98acd51648a7a14445'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.146553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5c16d5f5b44b98acd51648a7a14445'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.235553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5c16d5f5b44b98acd51648a7a14445'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:37.248537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1248/2490] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:36 2022] DELETE /identity/v3/users/0a5c16d5f5b44b98acd51648a7a14445 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:37.253323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.253810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.253910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.273146 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:37.274441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:37.335041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1243/2491] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:37.345238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.347721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:37.406825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1b9f3-46d4-4cfb-99b2-80d0496095bd admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.410723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.411334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.411620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.411896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.420865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.422350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.431830 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1249/2492] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:37.875923 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.886242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6e8dd-96a7-4998-8c2d-28ff9cea50a6 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.889939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.890543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.890821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.891154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.892846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:37.904728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.906231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:37.916587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1244/2493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:37.964596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:37.966131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:37.979907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48020-c2d9-428d-b260-3dad58f21185 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:37.984743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:37.985462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:37.985654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:37.985957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] PATH_INFO: `/v3/projects/2936003cc4fb4ff9931b961886bc7cb2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:37.987328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2936003cc4fb4ff9931b961886bc7cb2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:37.989693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:38.138096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2936003cc4fb4ff9931b961886bc7cb2', 'request_id': 'req-b7402dad-1627-4cb7-9610-42847bcae149'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.140290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:38.144926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2936003cc4fb4ff9931b961886bc7cb2', 'request_id': 'req-b7402dad-1627-4cb7-9610-42847bcae149'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.255974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2936003cc4fb4ff9931b961886bc7cb2', 'request_id': 'req-b7402dad-1627-4cb7-9610-42847bcae149'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.267380 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] The token cache is being invalidate because project 2936003cc4fb4ff9931b961886bc7cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:38.267786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.268477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.270014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1250/2494] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:37 2022] DELETE /identity/v3/projects/2936003cc4fb4ff9931b961886bc7cb2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:38.275315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:38.286474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f61bc-bf37-4ff5-9ae4-cd791c463409 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:38.293031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:38.356439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:38.357111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:38.357392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:38.357667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] PATH_INFO: `/v3/users/ce489d7c3dae4aa2b686872e2083989b` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:38.358879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce489d7c3dae4aa2b686872e2083989b)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:38.360801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:38.582365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce489d7c3dae4aa2b686872e2083989b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.583037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce489d7c3dae4aa2b686872e2083989b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.583654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce489d7c3dae4aa2b686872e2083989b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.595726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce489d7c3dae4aa2b686872e2083989b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.724977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-b2965884-386e-495b-984a-eab9933d7883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce489d7c3dae4aa2b686872e2083989b'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:38.742203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1245/2495] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:38 2022] DELETE /identity/v3/users/ce489d7c3dae4aa2b686872e2083989b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:39.311768 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.313322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.327857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7402dad-1627-4cb7-9610-42847bcae149 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.396992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.397644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.397990 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.398264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] PATH_INFO: `/v3/projects/02fa2a6c211d4d3ab8c3f0db23e314c2` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.399427 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=02fa2a6c211d4d3ab8c3f0db23e314c2)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.401371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.554692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02fa2a6c211d4d3ab8c3f0db23e314c2', 'request_id': 'req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.560927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02fa2a6c211d4d3ab8c3f0db23e314c2', 'request_id': 'req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.673055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02fa2a6c211d4d3ab8c3f0db23e314c2', 'request_id': 'req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.686116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] The token cache is being invalidate because project 02fa2a6c211d4d3ab8c3f0db23e314c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:39.686408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.687049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-93a33643-3ab6-41d3-9260-f7e5f9a6e2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:39.688536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1251/2496] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:39 2022] DELETE /identity/v3/projects/02fa2a6c211d4d3ab8c3f0db23e314c2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:39.693464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.694021 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.694219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.714023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:39.716595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.797031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1246/2497] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:39.798466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.798758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.799038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.821051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:39.823097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:39.837051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1252/2498] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:39.841519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.852750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb2905-20dd-4b3f-9266-ba736e35ba91 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.857606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.858255 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.858596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.858806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.859467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:39.859769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.861405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:39.877332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1247/2499] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:39.881905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:39.891952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6d910-6d29-47c0-b5ca-0153e77f01c1 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:39.897404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:39.898070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:39.898361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:39.898688 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:39.899334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:39.901267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.000825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1253/2500] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:39 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:40.005236 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.016610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b4e2-64e9-4412-a37d-76ee98e0e53c admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.029534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:40.076986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.077603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.077921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.078199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.078834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.080815 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.176230 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1248/2501] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:40 2022] POST /identity/v3/users => generated 282 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:40.180510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.191513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb42ed-6f1f-4acf-beaf-1d7155376d99 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.199412 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.200587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.200889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.201144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.201889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.204084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.219843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1254/2502] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:40.224095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.246715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f36ddc-6a41-472b-93d1-34759936d36e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.252372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345188e-6a21-40dd-a651-6375c5d44f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.253105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345188e-6a21-40dd-a651-6375c5d44f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.253391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345188e-6a21-40dd-a651-6375c5d44f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.253670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345188e-6a21-40dd-a651-6375c5d44f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.254519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345188e-6a21-40dd-a651-6375c5d44f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.256135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345188e-6a21-40dd-a651-6375c5d44f03 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.274670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1249/2503] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:40.276995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.292257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad56bb-2cf4-4bd6-82ef-695bc2458da6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.298228 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.299051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.304211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.304211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] PATH_INFO: `/v3/projects/540132c1f3704498bdd51d9d88f03582/users/e2156b54db3b486da01543d70783a4c1/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.317945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=540132c1f3704498bdd51d9d88f03582, user_id=e2156b54db3b486da01543d70783a4c1, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.320963 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.466564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1255/2504] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:40 2022] PUT /identity/v3/projects/540132c1f3704498bdd51d9d88f03582/users/e2156b54db3b486da01543d70783a4c1/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:40.477198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.477883 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.478237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.507521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] MFA Rules not processed for user `e2156b54db3b486da01543d70783a4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:40.508836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:40.576527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1250/2505] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:40.581944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.591944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:40.649718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c9d93-1760-4d19-9b32-fdc8ea74db10 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.655024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.666085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.666085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.666085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.666085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.666085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:40.820965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1256/2506] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:40 2022] POST /identity/v3/projects => generated 363 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:40.825269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:40.837577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e714b8-33f8-4b8e-b020-83193d150a9f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:40.903657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:40.904283 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:40.904568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:40.904848 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:40.905495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:40.907577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:41.042950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1251/2507] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:40 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:41.046945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:41.065509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f9e4-d686-48fa-852b-4583b1a0d220 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:41.074091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:41.075139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:41.075648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:41.076156 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:41.077371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:41.080676 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:41.100604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1257/2508] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:41.105507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:41.123759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce5795-cdb9-4626-b000-8cc89e097c24 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:41.132175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:41.133290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:41.133812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:41.134322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] PATH_INFO: `/v3/projects/fb293ed22b9c4be0b0bbc0dece541cb3/users/43a3c9168cf84f6e99fadc0795974bec/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:41.154700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:41.160454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb293ed22b9c4be0b0bbc0dece541cb3, user_id=43a3c9168cf84f6e99fadc0795974bec, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:41.163187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:41.269976 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1252/2509] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:41 2022] PUT /identity/v3/projects/fb293ed22b9c4be0b0bbc0dece541cb3/users/43a3c9168cf84f6e99fadc0795974bec/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:41.273648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:41.290980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794817f-4f5d-48ee-8cbf-8ffbac34f227 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:41.353923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaee9e-f661-4f10-a87d-f3f180fc5176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:41.355557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaee9e-f661-4f10-a87d-f3f180fc5176 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:41.356073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaee9e-f661-4f10-a87d-f3f180fc5176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:41.356351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaee9e-f661-4f10-a87d-f3f180fc5176 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:41.357250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaee9e-f661-4f10-a87d-f3f180fc5176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:41.358779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaee9e-f661-4f10-a87d-f3f180fc5176 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:41.369907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1258/2510] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:41.374438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:41.386042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aab7b-7b46-4d3b-8ab9-c8ad1a83acf8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:41.392036 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:41.392728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:41.393010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:41.393285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] PATH_INFO: `/v3/projects/fb293ed22b9c4be0b0bbc0dece541cb3/users/43a3c9168cf84f6e99fadc0795974bec/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:41.395355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb293ed22b9c4be0b0bbc0dece541cb3, user_id=43a3c9168cf84f6e99fadc0795974bec, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:41.398037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:41.410302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1253/2511] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:41 2022] PUT /identity/v3/projects/fb293ed22b9c4be0b0bbc0dece541cb3/users/43a3c9168cf84f6e99fadc0795974bec/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:41.485997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:41.486370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:41.486809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:41.530212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] MFA Rules not processed for user `43a3c9168cf84f6e99fadc0795974bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:41.531496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:41.646401 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1259/2512] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:41.654166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:41.656117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:41.737854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dd1c1-7a94-4924-a1bc-03f1b6e74c71 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:41.742986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:41.743510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:41.744525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:41.744867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:41.758415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:41.761030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:41.780633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1254/2513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:42.041125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:42.046171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:42.051930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dfa50-ffdb-4e4e-b9c1-4166e42eba0f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:42.064105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:42.064738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:42.065068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:42.065396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:42.112130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:42.113871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:42.134260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:42.136400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:42.148568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1260/2514] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:42.214341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba9aff-b47e-4273-87ff-2ac86850f155 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:42.220330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:42.220938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:42.221217 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:42.221485 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:42.223289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:42.238358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:42.240312 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:42.252441 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1255/2515] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:46.551171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:46.584253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:46.585862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:46.626051 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabc6a4-fd4b-4069-986b-a648f3ea75c4 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:46.631777 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:46.632422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:46.632709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:46.633005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] PATH_INFO: `/v3/users/e2156b54db3b486da01543d70783a4c1` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:46.634463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2156b54db3b486da01543d70783a4c1)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:46.636489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:46.656343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e1987-aebf-46bb-ba93-becdafa2d516 service placement] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:46.661518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:46.662196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:46.662480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:46.662757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] PATH_INFO: `/v3/users/1ebddb80fdb4411886e6204715a10e0e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:46.663914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebddb80fdb4411886e6204715a10e0e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:46.665897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:46.676552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:46.972934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2156b54db3b486da01543d70783a4c1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:46.973600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2156b54db3b486da01543d70783a4c1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:46.974262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2156b54db3b486da01543d70783a4c1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:46.987957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2156b54db3b486da01543d70783a4c1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:46.999809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebddb80fdb4411886e6204715a10e0e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.000547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebddb80fdb4411886e6204715a10e0e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.001167 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebddb80fdb4411886e6204715a10e0e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.014428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebddb80fdb4411886e6204715a10e0e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.113460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7f477cbe-bff0-4837-a23c-051ab2314d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2156b54db3b486da01543d70783a4c1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.127042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1261/2516] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:46 2022] DELETE /identity/v3/users/e2156b54db3b486da01543d70783a4c1 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:47.132099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:47.132245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:47.132515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:47.152024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:47.153337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:47.173047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:47.225691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1262/2517] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:47.235780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:47.240163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:47.276534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebddb80fdb4411886e6204715a10e0e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.292648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1256/2518] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:46 2022] DELETE /identity/v3/users/1ebddb80fdb4411886e6204715a10e0e => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:47.302360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf209c2-a61a-4a6a-90bd-b8759009e172 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:47.357631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:47.358282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:47.358561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:47.358835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:47.422879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:47.424336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:47.434382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1263/2519] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:56:47.591618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:47.593181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:47.622557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bd248-c9fd-4bce-9a01-ccb872d39094 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:47.625286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:47.626079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:47.626436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:47.626720 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] PATH_INFO: `/v3/projects/3b4d782ada9040819812a951b1b6e298` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:47.628549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4d782ada9040819812a951b1b6e298)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:47.630522 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:47.887366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4d782ada9040819812a951b1b6e298', 'request_id': 'req-266de751-2998-46f2-aa19-513e2edbc9a8'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.891347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4d782ada9040819812a951b1b6e298', 'request_id': 'req-266de751-2998-46f2-aa19-513e2edbc9a8'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:47.897592 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4d782ada9040819812a951b1b6e298', 'request_id': 'req-266de751-2998-46f2-aa19-513e2edbc9a8'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.019370 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] The token cache is being invalidate because project 3b4d782ada9040819812a951b1b6e298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:48.019650 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.019869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:48.020375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.021445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:48.022118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1257/2520] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:47 2022] DELETE /identity/v3/projects/3b4d782ada9040819812a951b1b6e298 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:48.036706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67543dca-2ad2-45d1-8212-f030585ebcb5 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:48.038484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:48.040051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:48.104410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:48.105088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:48.105372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:48.105802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] PATH_INFO: `/v3/projects/540132c1f3704498bdd51d9d88f03582` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:48.106975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540132c1f3704498bdd51d9d88f03582)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:48.108947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:48.112982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de751-2998-46f2-aa19-513e2edbc9a8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:48.122023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:48.122673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:48.122965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:48.123241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] PATH_INFO: `/v3/users/0bfd87e98ca24267a3da3a32a35f58b3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:48.124421 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfd87e98ca24267a3da3a32a35f58b3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:48.126443 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:48.141269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:48.229928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540132c1f3704498bdd51d9d88f03582', 'request_id': 'req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.236200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540132c1f3704498bdd51d9d88f03582', 'request_id': 'req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.335882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540132c1f3704498bdd51d9d88f03582', 'request_id': 'req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.347587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] The token cache is being invalidate because project 540132c1f3704498bdd51d9d88f03582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:48.347817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.348477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.350030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1264/2521] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:48 2022] DELETE /identity/v3/projects/540132c1f3704498bdd51d9d88f03582 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:48.354022 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:48.355447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:48.371163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:48.384832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfd87e98ca24267a3da3a32a35f58b3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.385512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfd87e98ca24267a3da3a32a35f58b3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.386153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfd87e98ca24267a3da3a32a35f58b3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.399181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfd87e98ca24267a3da3a32a35f58b3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.426121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519e5e3-5f03-41cb-bd86-b79b03ee89d1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:48.430821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:48.431453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:48.431738 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:48.432010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] PATH_INFO: `/v3/users/43a3c9168cf84f6e99fadc0795974bec` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:48.433145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a3c9168cf84f6e99fadc0795974bec)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:48.435090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:48.627161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfd87e98ca24267a3da3a32a35f58b3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.642894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1258/2522] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:48 2022] DELETE /identity/v3/users/0bfd87e98ca24267a3da3a32a35f58b3 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:48.756112 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a3c9168cf84f6e99fadc0795974bec'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.756903 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a3c9168cf84f6e99fadc0795974bec'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.758105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a3c9168cf84f6e99fadc0795974bec'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.773275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a3c9168cf84f6e99fadc0795974bec'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.886901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a3c9168cf84f6e99fadc0795974bec'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:48.902374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1265/2523] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:56:48 2022] DELETE /identity/v3/users/43a3c9168cf84f6e99fadc0795974bec => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:56:48.920560 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:48.934267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:48.935899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.008968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6336-3388-4e9d-88e2-667d0d3a5433 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:49.073096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:49.073790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.074049 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.074328 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] PATH_INFO: `/v3/projects/70a3340a3a5449e9ad09da56d0fbd64c` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.075471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a3340a3a5449e9ad09da56d0fbd64c)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:49.077417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:49.276157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a3340a3a5449e9ad09da56d0fbd64c', 'request_id': 'req-521e4e24-1da2-4102-9ab2-af37004b314d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.282980 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a3340a3a5449e9ad09da56d0fbd64c', 'request_id': 'req-521e4e24-1da2-4102-9ab2-af37004b314d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.289173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a3340a3a5449e9ad09da56d0fbd64c', 'request_id': 'req-521e4e24-1da2-4102-9ab2-af37004b314d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.394697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] The token cache is being invalidate because project 70a3340a3a5449e9ad09da56d0fbd64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:49.395003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.396268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:49.396728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-521e4e24-1da2-4102-9ab2-af37004b314d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.397644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.409910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1259/2524] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:48 2022] DELETE /identity/v3/projects/70a3340a3a5449e9ad09da56d0fbd64c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:49.413646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaaf5fc-5964-4207-b498-8ae7079a3468 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:49.494532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:49.495218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.495495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.495840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] PATH_INFO: `/v3/projects/fb293ed22b9c4be0b0bbc0dece541cb3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.497161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb293ed22b9c4be0b0bbc0dece541cb3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:49.499201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:49.511410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:49.667314 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb293ed22b9c4be0b0bbc0dece541cb3', 'request_id': 'req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.675438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb293ed22b9c4be0b0bbc0dece541cb3', 'request_id': 'req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.766662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb293ed22b9c4be0b0bbc0dece541cb3', 'request_id': 'req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.778358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] The token cache is being invalidate because project fb293ed22b9c4be0b0bbc0dece541cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:56:49.778649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.779297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-0cdba7c4-53ba-4d37-a215-a6ec3dca048c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:56:49.781163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1266/2525] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:56:49 2022] DELETE /identity/v3/projects/fb293ed22b9c4be0b0bbc0dece541cb3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:49.787076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.787921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.788202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.808084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:49.809257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.874121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1260/2526] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:49.881970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.882303 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.882474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.902478 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:49.903702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:49.913151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1267/2527] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:49.917409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:49.927204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0030e-2a09-402c-87b5-7fe18affb4f1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:49.931873 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:49.932476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.932839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.933037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.933695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:56:49.934035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:49.935666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:49.948237 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1261/2528] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:56:49.952424 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:49.962687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bacd3a-4a44-487a-b8fa-48d23b70396a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:49.967536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:49.968148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:49.968429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:49.968705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:49.969341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:49.971275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.095548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1268/2529] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:49 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:50.101264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.117097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e500f02a-27a1-44e8-85fd-391ddfe6290a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.180631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.181238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.181517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.181817 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.182504 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.184406 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.298580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1262/2530] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:50.302970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.313645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b281f19-21b8-4881-bba6-0f6884444216 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.318896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.319502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.319784 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.320061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.320714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.322358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.333839 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1269/2531] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:50.356333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.367169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d8a94-7781-4034-b109-1fb061b81910 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.372489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da094358-9750-4793-80a3-ea61e9881ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.373109 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094358-9750-4793-80a3-ea61e9881ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.373394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094358-9750-4793-80a3-ea61e9881ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.373690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094358-9750-4793-80a3-ea61e9881ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.374359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da094358-9750-4793-80a3-ea61e9881ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.376086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da094358-9750-4793-80a3-ea61e9881ea7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.388534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1263/2532] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:50.393076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.404237 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde67bf-c4c4-4904-b661-efab264815d8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.410746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.410746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.410746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.410746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] PATH_INFO: `/v3/projects/0d11f4aef13141b4a43db7e7dbf963f3/users/7ed308aaba8b4625af9c31059d567577/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.426218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d11f4aef13141b4a43db7e7dbf963f3, user_id=7ed308aaba8b4625af9c31059d567577, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.428845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.573569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1270/2533] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:50 2022] PUT /identity/v3/projects/0d11f4aef13141b4a43db7e7dbf963f3/users/7ed308aaba8b4625af9c31059d567577/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:50.585844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.586137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.586416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.614662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] MFA Rules not processed for user `7ed308aaba8b4625af9c31059d567577`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:50.615897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:50.681624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1264/2534] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:50.686300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.691110 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:50.730507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:50.750405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45ec51-d63b-428b-9daa-9546c99b27ed admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:50.755984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:50.756594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:50.756877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:50.757152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:50.757813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:50.759763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:50.954370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1271/2535] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:50.958326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:50.969382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b270a47-08c7-414f-b210-8e321c65fea7 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:51.028222 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:51.028861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.029163 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.029418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.030077 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:51.032007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:51.138144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1265/2536] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:56:50 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:56:51.142343 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:51.153598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce95d8-3663-49e5-8f66-6a388a732db3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:51.161316 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:51.162477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.162811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.163152 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.163757 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:51.165409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:51.180526 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1272/2537] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:51.181713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:51.192144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0e6aa-0934-4688-8901-16c51de672f7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:51.196911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:51.197582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.197905 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.198186 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] PATH_INFO: `/v3/projects/a99a452e81e64b8cbf37b5e93f6cf0f1/users/84f78a7716b84e0d9d658d1155b1c108/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.214275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99a452e81e64b8cbf37b5e93f6cf0f1, user_id=84f78a7716b84e0d9d658d1155b1c108, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:51.216900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:51.344369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1266/2538] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:51 2022] PUT /identity/v3/projects/a99a452e81e64b8cbf37b5e93f6cf0f1/users/84f78a7716b84e0d9d658d1155b1c108/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:51.351005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:51.362194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5c8b5-dbaf-4dd8-b528-e0f9fd653adb admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:51.418081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba12d-a97b-47e8-8ac6-65019de1e477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:51.418780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba12d-a97b-47e8-8ac6-65019de1e477 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.418948 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba12d-a97b-47e8-8ac6-65019de1e477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.419219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba12d-a97b-47e8-8ac6-65019de1e477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.419851 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba12d-a97b-47e8-8ac6-65019de1e477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:51.421441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba12d-a97b-47e8-8ac6-65019de1e477 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:51.431703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1273/2539] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:56:51.436270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:51.448200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf5664-2c6d-462a-af56-5dec1161b6ee admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:51.454973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:51.455694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.456502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.456775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] PATH_INFO: `/v3/projects/a99a452e81e64b8cbf37b5e93f6cf0f1/users/84f78a7716b84e0d9d658d1155b1c108/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.458915 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99a452e81e64b8cbf37b5e93f6cf0f1, user_id=84f78a7716b84e0d9d658d1155b1c108, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:51.461578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:51.473175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1267/2540] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:56:51 2022] PUT /identity/v3/projects/a99a452e81e64b8cbf37b5e93f6cf0f1/users/84f78a7716b84e0d9d658d1155b1c108/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:56:51.483945 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.484239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.484512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.513454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] MFA Rules not processed for user `84f78a7716b84e0d9d658d1155b1c108`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:51.514731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:51.583867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1274/2541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:56:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:51.594734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:51.596415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:51.656654 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568b129-bbd8-4c94-b68d-2dbb641b4fef admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:51.660839 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cc46e-626f-466f-9a60-37e0a7f4d632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:51.661464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc46e-626f-466f-9a60-37e0a7f4d632 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:51.661746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc46e-626f-466f-9a60-37e0a7f4d632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:51.662051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cc46e-626f-466f-9a60-37e0a7f4d632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:51.721251 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc46e-626f-466f-9a60-37e0a7f4d632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:51.725362 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cc46e-626f-466f-9a60-37e0a7f4d632 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:51.732402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1268/2542] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:51.761142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:51.886840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:56:58.763961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:58.765394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:58.777810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf65391-5db2-4a3d-ade8-a840a135e0f2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:58.781926 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:58.782537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:58.782818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:58.783749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:58.793472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:58.794933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:58.804452 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1275/2543] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:56:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:56:59.364781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:59.365359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:59.365498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:59.387913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:56:59.393126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:59.482540 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1269/2544] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:56:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:56:59.493041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:56:59.493370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:56:59.570435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8fcc7-6329-4418-bdf1-9a3d8e9dc9ac service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:56:59.575542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795fd5c-0e17-4f62-a876-c1b3f0e36366 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:56:59.576118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795fd5c-0e17-4f62-a876-c1b3f0e36366 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:56:59.576476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795fd5c-0e17-4f62-a876-c1b3f0e36366 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:56:59.576728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795fd5c-0e17-4f62-a876-c1b3f0e36366 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:56:59.586020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795fd5c-0e17-4f62-a876-c1b3f0e36366 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:56:59.587669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795fd5c-0e17-4f62-a876-c1b3f0e36366 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:56:59.596379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1276/2545] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:09.451155 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=39 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:09.593050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=39 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:19.900114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:19.979347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003adfe1-b627-4fc1-97f0-ac5c1982adc9 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:19.983662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:19.984309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:19.984672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:19.984951 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] PATH_INFO: `/v3/users/7ed308aaba8b4625af9c31059d567577` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:19.986152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed308aaba8b4625af9c31059d567577)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:19.988061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:20.213413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed308aaba8b4625af9c31059d567577'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:20.214142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed308aaba8b4625af9c31059d567577'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:20.214760 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed308aaba8b4625af9c31059d567577'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:20.228160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed308aaba8b4625af9c31059d567577'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:20.351942 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed308aaba8b4625af9c31059d567577'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:20.365242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1270/2546] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:19 2022] DELETE /identity/v3/users/7ed308aaba8b4625af9c31059d567577 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:20.371193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:20.371741 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:20.371970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:20.393245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:20.394496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:20.458415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1277/2547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:20.481270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:20.482646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:20.566764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a12a-24d4-4e24-9040-477a81fc60e2 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:20.572239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:20.573449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:20.573743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:20.574052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:20.586125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:20.587646 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:20.598234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1271/2548] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:21.028696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:21.034106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:21.044852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260655fa-1a24-4b22-8fbe-18594346b8a2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:21.059716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:21.060670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:21.061134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:21.061574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] PATH_INFO: `/v3/projects/0d11f4aef13141b4a43db7e7dbf963f3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:21.062992 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d11f4aef13141b4a43db7e7dbf963f3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:21.081898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:21.205070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d11f4aef13141b4a43db7e7dbf963f3', 'request_id': 'req-8c0cd361-d356-4ba4-a3db-be447a77e1d2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.211994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d11f4aef13141b4a43db7e7dbf963f3', 'request_id': 'req-8c0cd361-d356-4ba4-a3db-be447a77e1d2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.322985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d11f4aef13141b4a43db7e7dbf963f3', 'request_id': 'req-8c0cd361-d356-4ba4-a3db-be447a77e1d2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.334982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] The token cache is being invalidate because project 0d11f4aef13141b4a43db7e7dbf963f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:21.335278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.335942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-8c0cd361-d356-4ba4-a3db-be447a77e1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.337637 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1278/2549] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:21 2022] DELETE /identity/v3/projects/0d11f4aef13141b4a43db7e7dbf963f3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:21.341556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:21.356384 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97282e9d-d8b7-4d83-a596-470a24971f51 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:21.377858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:21.423632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:21.424321 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:21.424601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:21.425189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] PATH_INFO: `/v3/users/84f78a7716b84e0d9d658d1155b1c108` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:21.426398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f78a7716b84e0d9d658d1155b1c108)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:21.428953 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:21.656950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f78a7716b84e0d9d658d1155b1c108'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.657843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f78a7716b84e0d9d658d1155b1c108'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.658461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f78a7716b84e0d9d658d1155b1c108'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.672725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f78a7716b84e0d9d658d1155b1c108'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.826567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-60c104ef-eac1-4f2f-b937-173c6446f74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f78a7716b84e0d9d658d1155b1c108'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:21.841134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1272/2550] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:21 2022] DELETE /identity/v3/users/84f78a7716b84e0d9d658d1155b1c108 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:21.995106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a2e5b-f87c-408b-a6f4-9b0e948ca7cd None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:21.995705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a2e5b-f87c-408b-a6f4-9b0e948ca7cd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:21.995705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a2e5b-f87c-408b-a6f4-9b0e948ca7cd None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:21.997128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1279/2551] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:57:22.003277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.003415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.003897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.038670 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:22.043896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.116840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1273/2552] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:57:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:22.157723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a2e5b-f87c-408b-a6f4-9b0e948ca7cd None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:22.157723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-974a2e5b-f87c-408b-a6f4-9b0e948ca7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.198548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a2e5b-f87c-408b-a6f4-9b0e948ca7cd None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:22.198548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbc3cb-da87-42d6-8b17-e86cba58a109 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:22.198548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbc3cb-da87-42d6-8b17-e86cba58a109 service glance] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.198548 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbc3cb-da87-42d6-8b17-e86cba58a109 service glance] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.199120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbc3cb-da87-42d6-8b17-e86cba58a109 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.210057 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbc3cb-da87-42d6-8b17-e86cba58a109 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:22.211614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbc3cb-da87-42d6-8b17-e86cba58a109 service glance] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:22.222929 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1280/2553] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:22.354239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:22.356154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.371455 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:22.426344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62946a50-f0f7-4fc5-8af1-24c04d0bb6ec None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:22.430997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:22.431630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.431914 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.432210 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] PATH_INFO: `/v3/projects/a99a452e81e64b8cbf37b5e93f6cf0f1` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.433401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99a452e81e64b8cbf37b5e93f6cf0f1)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:22.435363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:22.469758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcf057-661d-45bd-a348-cdbcc5130190 None None] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.469758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcf057-661d-45bd-a348-cdbcc5130190 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.469758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcf057-661d-45bd-a348-cdbcc5130190 None None] PATH_INFO: `/` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.469758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1281/2554] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 03:57:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 03:57:22.472142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.472428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.472702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.493408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] MFA Rules not processed for user `21235d5078fc408da2d9f4e35ab51a79`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:22.494696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.517982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:22.561532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1282/2555] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 03:57:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:22.574425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:22.575936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.587394 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68b826-5cd2-4ced-a7ca-fbdd910fed6c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:22.587631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99a452e81e64b8cbf37b5e93f6cf0f1', 'request_id': 'req-568df24c-5015-421b-8b1a-75dd17a81067'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:22.595728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99a452e81e64b8cbf37b5e93f6cf0f1', 'request_id': 'req-568df24c-5015-421b-8b1a-75dd17a81067'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:22.601939 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99a452e81e64b8cbf37b5e93f6cf0f1', 'request_id': 'req-568df24c-5015-421b-8b1a-75dd17a81067'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:22.637956 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68694e0-b82c-40e7-b4c6-441d896e2055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:22.638584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68694e0-b82c-40e7-b4c6-441d896e2055 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.638868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68694e0-b82c-40e7-b4c6-441d896e2055 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.639140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68694e0-b82c-40e7-b4c6-441d896e2055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.646474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68694e0-b82c-40e7-b4c6-441d896e2055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:22.648453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68694e0-b82c-40e7-b4c6-441d896e2055 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:22.656338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1283/2556] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:57:22.771183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] The token cache is being invalidate because project a99a452e81e64b8cbf37b5e93f6cf0f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:22.771480 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:22.772104 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-568df24c-5015-421b-8b1a-75dd17a81067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:22.773605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1274/2557] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:22 2022] DELETE /identity/v3/projects/a99a452e81e64b8cbf37b5e93f6cf0f1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:57:22.778627 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.778920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.779219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.799719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:22.800949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.859135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1284/2558] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:22.867736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.868023 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.868302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.894123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:22.895373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:22.903737 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1275/2559] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:22.908823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:22.919147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31be58-e2f0-41f5-a0d9-baa5da05fa34 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:22.931212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:22.931833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.932115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.932447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.933100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:22.933406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:22.935105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:22.947467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1285/2560] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:22.952046 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:22.961313 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b71074-a42e-42f0-9bbd-43d4b9c02776 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:22.966011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:22.966608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:22.966891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:22.967211 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:22.967842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:22.969732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.116919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1276/2561] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:22 2022] POST /identity/v3/projects => generated 407 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:23.118334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.128868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdde3e-a827-420e-aed5-ec1109eaa54c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.190922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.191529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.191813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.192139 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.192779 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.194730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.297797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1286/2562] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:23 2022] POST /identity/v3/users => generated 304 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:23.302045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.312878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb462e-c9b2-472f-8cef-fb632ac36c86 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.317867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.318723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.319148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.319531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.320187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.321853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.332082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1277/2563] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:23.338229 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.348568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd2f85-b229-4b67-927f-e5790ed6024a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.353877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f87e33-a989-46c6-9d6a-459440c1585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.354480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f87e33-a989-46c6-9d6a-459440c1585e admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.355778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f87e33-a989-46c6-9d6a-459440c1585e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.355778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f87e33-a989-46c6-9d6a-459440c1585e admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.355778 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f87e33-a989-46c6-9d6a-459440c1585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.357372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f87e33-a989-46c6-9d6a-459440c1585e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.369012 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1287/2564] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:23.373358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.383582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9426fd-5beb-4da5-8a8d-753e4a3419be admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.388339 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.388992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.389276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.389554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] PATH_INFO: `/v3/projects/c2dc61521c4046008bd3470d48a4a057/users/d529fe52849c4d91b92e5e9279ac7a48/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.405683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dc61521c4046008bd3470d48a4a057, user_id=d529fe52849c4d91b92e5e9279ac7a48, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.408687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.494822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:23.501324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1278/2565] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:23 2022] PUT /identity/v3/projects/c2dc61521c4046008bd3470d48a4a057/users/d529fe52849c4d91b92e5e9279ac7a48/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:23.511899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.512174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.512447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.542464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] MFA Rules not processed for user `d529fe52849c4d91b92e5e9279ac7a48`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:23.543788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:23.609449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1288/2566] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:23 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:23.614153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.657711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:23.677640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb776a8e-edd4-4414-bed5-d9075f1d7b0a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.682636 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.683242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.683521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.683811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.684475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.686416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.783914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.785328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:23.816712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1279/2567] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:23 2022] POST /identity/v3/projects => generated 409 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:23.827299 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:23.844587 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5da38-7566-449c-b975-b642a22d0855 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.880454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60cd92-3f5b-49b2-b493-761c08c42d95 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:23.885930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.886696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.887105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.887855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.888440 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.890451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.896176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:23.902068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:23.902068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:23.902068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:23.902068 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:23.945395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:23.975363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:23.976861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:23.988337 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1289/2568] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:57:24.023967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1280/2569] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:23 2022] POST /identity/v3/users => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:24.031088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.044967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee6dae-deef-464c-9c3e-1afaa168e1e6 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.049869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.050646 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.050991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.051334 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.052113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.053942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.070605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1290/2570] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:57:24.071745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.082612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a1e81-4926-43b5-8014-45d3e61b74be admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.088333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.088989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.089402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.089565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] PATH_INFO: `/v3/projects/79d05d1f817844b9af87fd61e4172194/users/2f48b578dc8f4673a624b97439b4e25d/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.104886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d05d1f817844b9af87fd61e4172194, user_id=2f48b578dc8f4673a624b97439b4e25d, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.107545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.215224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1281/2571] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:24 2022] PUT /identity/v3/projects/79d05d1f817844b9af87fd61e4172194/users/2f48b578dc8f4673a624b97439b4e25d/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:24.219331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.229838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd2ef7-3ab4-4db6-a901-afdb3cff68a5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.297551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e3ff2-e58a-492d-8202-10fac508fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.298211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3ff2-e58a-492d-8202-10fac508fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.298496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3ff2-e58a-492d-8202-10fac508fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.298792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e3ff2-e58a-492d-8202-10fac508fd91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.299429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e3ff2-e58a-492d-8202-10fac508fd91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.301215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e3ff2-e58a-492d-8202-10fac508fd91 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.315835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1291/2572] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:24.317084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.332018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57f88f-1824-4fe0-abe8-ffc3f4a797e5 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.340331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.341519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.342047 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.343945 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] PATH_INFO: `/v3/projects/79d05d1f817844b9af87fd61e4172194/users/2f48b578dc8f4673a624b97439b4e25d/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.345034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d05d1f817844b9af87fd61e4172194, user_id=2f48b578dc8f4673a624b97439b4e25d, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.347721 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.359058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1282/2573] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:24 2022] PUT /identity/v3/projects/79d05d1f817844b9af87fd61e4172194/users/2f48b578dc8f4673a624b97439b4e25d/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:24.370185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.372620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.372620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.401127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] MFA Rules not processed for user `2f48b578dc8f4673a624b97439b4e25d`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:24.402558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:24.471949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1292/2574] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:24 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:24.483377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:24.485137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:24.545147 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95bfd4-434d-4eda-a8a3-dcef86f2fee4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:24.550515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:24.551121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:24.551452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:24.551730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:24.561687 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:24.563190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:24.575153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1283/2575] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:24.997244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:25.007052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745907e-a025-480d-b0d0-05f4f35c83b3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:25.010625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fec1c-faab-44bb-a0b7-e8470596251a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:25.011222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fec1c-faab-44bb-a0b7-e8470596251a service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.011532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fec1c-faab-44bb-a0b7-e8470596251a service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.011809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fec1c-faab-44bb-a0b7-e8470596251a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.053016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:25.070344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fec1c-faab-44bb-a0b7-e8470596251a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:25.071817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fec1c-faab-44bb-a0b7-e8470596251a service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:25.080679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1293/2576] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:25.428194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:25.452246 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:25.503201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae04e-6fae-4018-8bca-a9982a635155 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:25.507792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:25.508409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:25.508684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:25.508956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:25.510864 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:25.589277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:25.590971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:25.603150 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1284/2577] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:30.118867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:30.119361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:30.119475 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:30.139845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:30.141083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:30.187695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:30.187695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:30.195608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c2ac-7b86-4319-a325-01faa8b3b643 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:30.199537 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:30.200122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:30.200399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:30.200668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] PATH_INFO: `/v3/users/68eff070a8eb4497af4e8ed2b5110405` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:30.201957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68eff070a8eb4497af4e8ed2b5110405)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:30.203924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:30.220869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1294/2578] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:57:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:30.233911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:30.235439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:30.308464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa410d6-fd46-4a8b-ba55-6afc066f4c0a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:30.313735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:30.314377 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:30.314662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:30.315006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:30.324297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:30.341993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:30.341993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1295/2579] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:57:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:57:30.648374 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68eff070a8eb4497af4e8ed2b5110405'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:30.651280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68eff070a8eb4497af4e8ed2b5110405'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:30.651280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68eff070a8eb4497af4e8ed2b5110405'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:30.661806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68eff070a8eb4497af4e8ed2b5110405'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:30.829274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-052cc615-5f08-46d5-a471-b7847990ad24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68eff070a8eb4497af4e8ed2b5110405'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:30.860002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1285/2580] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:30 2022] DELETE /identity/v3/users/68eff070a8eb4497af4e8ed2b5110405 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:31.260819 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:31.275439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33e7b6-10e5-48a8-9655-b5f381b2d56c service swift] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:31.376354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:31.377402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:31.377683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:31.377989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] PATH_INFO: `/v3/projects/09c5c40394824e13b6d91dfa676a2c3e` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:31.379360 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c5c40394824e13b6d91dfa676a2c3e)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:31.381573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:31.400731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:31.693449 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c5c40394824e13b6d91dfa676a2c3e', 'request_id': 'req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:31.701786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c5c40394824e13b6d91dfa676a2c3e', 'request_id': 'req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:31.938361 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c5c40394824e13b6d91dfa676a2c3e', 'request_id': 'req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:31.954962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] The token cache is being invalidate because project 09c5c40394824e13b6d91dfa676a2c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:31.955467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:31.956833 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-44560f9b-88e4-43b8-8729-6bad6f9e4d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:31.959025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1296/2581] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:31 2022] DELETE /identity/v3/projects/09c5c40394824e13b6d91dfa676a2c3e => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:31.965277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:31.965875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:31.965963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:31.990637 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:31.991881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:32.041922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:32.065828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1286/2582] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:32.074626 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.074911 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.075193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.098976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:32.100418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:32.109301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1297/2583] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:32.113453 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:32.123749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0df35-e45f-4493-9c2e-fe873c8a009d None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:32.128814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:32.129460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.129744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.130083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.130729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:32.131566 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:32.133176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:32.145804 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1287/2584] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:32.151090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:32.161837 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c114b-d667-4e13-8e12-6b4ddc40be27 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:32.167006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:32.167629 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.167983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.168612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.169256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:32.172000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:32.464788 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1298/2585] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:32 2022] POST /identity/v3/projects => generated 371 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:32.469675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:32.480819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e17092-7e80-49de-8b98-70ce32e4e2d2 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:32.547012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:32.547641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.547932 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.548201 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.548989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:32.551035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:32.840151 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1288/2586] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:32 2022] POST /identity/v3/users => generated 286 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:32.848600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:32.860363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ab7cf-701e-4c56-8b1f-32f0eb2e097b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:32.865267 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:32.865953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.866240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.866514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.867168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:32.869866 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:32.881826 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1299/2587] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:32.885079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:32.895629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c318fa-1b92-4220-ba41-a9b02f431cfc admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:32.901252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad15243-7103-491a-8f62-772b87e573e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:32.901837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad15243-7103-491a-8f62-772b87e573e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.902199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad15243-7103-491a-8f62-772b87e573e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.902550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad15243-7103-491a-8f62-772b87e573e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.903285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad15243-7103-491a-8f62-772b87e573e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:32.904971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad15243-7103-491a-8f62-772b87e573e8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:32.922323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1289/2588] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:32.924131 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:32.935896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e559a-e893-42ff-a95d-93db429fda77 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:32.941397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:32.941612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:32.942221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:32.942358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] PATH_INFO: `/v3/projects/600c3a7f1074427eb47384378c39704a/users/e00ae732a8b74e00920d1b86792b7403/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:32.961614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=600c3a7f1074427eb47384378c39704a, user_id=e00ae732a8b74e00920d1b86792b7403, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:32.970001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:33.057178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1300/2589] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:32 2022] PUT /identity/v3/projects/600c3a7f1074427eb47384378c39704a/users/e00ae732a8b74e00920d1b86792b7403/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:33.061619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:33.062143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:33.062315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:33.097179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] MFA Rules not processed for user `e00ae732a8b74e00920d1b86792b7403`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:33.098512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:33.176988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1290/2590] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:33.188336 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:33.190429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:33.284709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb561-d1a2-42f9-902c-110ec96afc5c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:33.290912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81def7-8f8c-462e-8dec-6472974d5f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:33.291519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81def7-8f8c-462e-8dec-6472974d5f0f service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:33.299457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81def7-8f8c-462e-8dec-6472974d5f0f service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:33.299457 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81def7-8f8c-462e-8dec-6472974d5f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:33.301296 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81def7-8f8c-462e-8dec-6472974d5f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:33.303474 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81def7-8f8c-462e-8dec-6472974d5f0f service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:33.312989 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1301/2591] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:57:33.481169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:33.482623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:33.531096 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:33.557366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e0e0c-e036-4898-937f-3b7620b2cb2f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:33.562323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:33.563118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:33.563408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:33.563805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] PATH_INFO: `/v3/users/d529fe52849c4d91b92e5e9279ac7a48` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:33.564871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d529fe52849c4d91b92e5e9279ac7a48)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:33.566855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:33.844057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd529fe52849c4d91b92e5e9279ac7a48'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:33.845051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd529fe52849c4d91b92e5e9279ac7a48'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:33.845882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd529fe52849c4d91b92e5e9279ac7a48'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:33.862439 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd529fe52849c4d91b92e5e9279ac7a48'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:33.939878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd529fe52849c4d91b92e5e9279ac7a48'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:33.955159 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1291/2592] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:33 2022] DELETE /identity/v3/users/d529fe52849c4d91b92e5e9279ac7a48 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:33.960318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:33.963055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:33.963055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:33.979984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:33.981258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:34.008959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:34.051890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1302/2593] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:34.062005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:34.063625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:34.158519 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2cf9e-e49a-4c76-b7af-e6232296369a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:34.163827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:34.164761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:34.165232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:34.165661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:34.180404 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:34.182698 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:34.196881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1292/2594] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:34.773816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:34.775409 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:34.790961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd49ffa-edf0-47fe-a8c3-6784f58995c7 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:34.806595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:34.807439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:34.807785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:34.808232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] PATH_INFO: `/v3/projects/c2dc61521c4046008bd3470d48a4a057` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:34.809648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dc61521c4046008bd3470d48a4a057)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:34.811671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:34.946069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dc61521c4046008bd3470d48a4a057', 'request_id': 'req-a9628425-4338-4f46-b601-c5db24e4348b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:34.953277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dc61521c4046008bd3470d48a4a057', 'request_id': 'req-a9628425-4338-4f46-b601-c5db24e4348b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.037081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dc61521c4046008bd3470d48a4a057', 'request_id': 'req-a9628425-4338-4f46-b601-c5db24e4348b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.050546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] The token cache is being invalidate because project c2dc61521c4046008bd3470d48a4a057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:35.058142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.058142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.058142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1303/2595] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:34 2022] DELETE /identity/v3/projects/c2dc61521c4046008bd3470d48a4a057 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:35.060917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:35.071553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096bb78-3831-46b6-87e6-638f38436698 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:35.134056 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:35.134702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:35.134986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:35.135261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] PATH_INFO: `/v3/users/2f48b578dc8f4673a624b97439b4e25d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:35.136401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f48b578dc8f4673a624b97439b4e25d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:35.138375 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:35.140136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:35.349847 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f48b578dc8f4673a624b97439b4e25d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.352004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f48b578dc8f4673a624b97439b4e25d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.352004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f48b578dc8f4673a624b97439b4e25d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.364554 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f48b578dc8f4673a624b97439b4e25d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.488020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ac321ca1-3e91-4135-bca2-8d720b403406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f48b578dc8f4673a624b97439b4e25d'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:35.513429 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1293/2596] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:35 2022] DELETE /identity/v3/users/2f48b578dc8f4673a624b97439b4e25d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:35.999889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:35.999889 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:36.014090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9628425-4338-4f46-b601-c5db24e4348b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:36.083594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:36.085605 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.086132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.086723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] PATH_INFO: `/v3/projects/79d05d1f817844b9af87fd61e4172194` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.088177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d05d1f817844b9af87fd61e4172194)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:36.090459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:36.223305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d05d1f817844b9af87fd61e4172194', 'request_id': 'req-47c8fcee-6e9a-487b-b005-22bf36635a36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:36.226281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:36.231260 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d05d1f817844b9af87fd61e4172194', 'request_id': 'req-47c8fcee-6e9a-487b-b005-22bf36635a36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:36.316798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d05d1f817844b9af87fd61e4172194', 'request_id': 'req-47c8fcee-6e9a-487b-b005-22bf36635a36'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:36.329148 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] The token cache is being invalidate because project 79d05d1f817844b9af87fd61e4172194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:36.329442 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:36.330122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-47c8fcee-6e9a-487b-b005-22bf36635a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:36.331868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1304/2597] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:35 2022] DELETE /identity/v3/projects/79d05d1f817844b9af87fd61e4172194 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:36.337478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.337990 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.338111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.359119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:36.360355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:36.443484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1294/2598] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:36.456703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.456703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.456703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.481059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:36.482339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:36.491832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1305/2599] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:36.495743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:36.507686 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b599c6-7351-4f89-87a5-105a2a848aa8 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:36.515080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:36.515747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.516013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.516279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.516934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:36.517233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:36.518906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:36.534305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1295/2600] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:36.544564 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:36.555707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cad0e9-d57b-4718-9533-8dffcc060803 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:36.560930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:36.561550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.561887 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.562114 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.566167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:36.568197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:36.748391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1306/2601] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:36 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:36.748711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:36.762015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07920130-fa3c-4d54-9df9-b724d1401fe8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:36.848002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:36.848002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.848002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.848002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.848577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:36.848577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:36.856103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:36.857922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:36.862320 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:36.872927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989886-598c-4da9-aaef-fe6f53e33b2c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:36.877816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:36.878477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:36.878759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:36.879034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] PATH_INFO: `/v3/users/e00ae732a8b74e00920d1b86792b7403` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:36.880201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00ae732a8b74e00920d1b86792b7403)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:36.882864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:36.985901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1296/2602] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:36 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:36.990011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:37.002560 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390223-8b73-4cfe-b47b-04d75102e961 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:37.007377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:37.007992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.008274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.008550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.009224 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:37.012845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:37.026394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1297/2603] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:37.027547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:37.039527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a2566-857c-4922-ac3f-9e8af58db7b0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:37.044922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:37.049679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.049679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.049679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.049679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:37.049679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:37.061243 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1298/2604] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:37.065353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:37.075878 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b8052-5441-4a2a-a0b6-88ff21f6d5ba admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:37.089950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4f973-a4ec-4f34-87e1-acc969464356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:37.089950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f973-a4ec-4f34-87e1-acc969464356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.090308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00ae732a8b74e00920d1b86792b7403'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:37.090745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f973-a4ec-4f34-87e1-acc969464356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.090745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4f973-a4ec-4f34-87e1-acc969464356 admin admin] PATH_INFO: `/v3/projects/2cde328428bb4ca9b1710a760f1f33da/users/9e4f4a622faa41f3a996fdefffd09361/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.090919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00ae732a8b74e00920d1b86792b7403'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:37.090919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00ae732a8b74e00920d1b86792b7403'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:37.103857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00ae732a8b74e00920d1b86792b7403'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:37.108467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f973-a4ec-4f34-87e1-acc969464356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cde328428bb4ca9b1710a760f1f33da, user_id=9e4f4a622faa41f3a996fdefffd09361, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:37.111262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4f973-a4ec-4f34-87e1-acc969464356 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:37.194203 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2c123961-dbb5-4ac5-a788-e13280628439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00ae732a8b74e00920d1b86792b7403'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:37.204692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1299/2605] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:37 2022] PUT /identity/v3/projects/2cde328428bb4ca9b1710a760f1f33da/users/9e4f4a622faa41f3a996fdefffd09361/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:57:37.206214 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.206543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.206822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.219953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1307/2606] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:36 2022] DELETE /identity/v3/users/e00ae732a8b74e00920d1b86792b7403 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:37.224425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.225355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.225639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.230449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:37.234600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:37.248820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:37.250091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:37.329082 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1308/2607] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:37.338270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1300/2608] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:37.347568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:37.347568 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:37.357122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:37.358818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:37.450113 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eeff03-6bb1-4159-8cf9-77e586971ef4 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:37.459659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:37.460351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.460618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.460889 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.483777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:37.484856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:37.495933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1301/2609] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:57:37.512324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:37.553399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc09b02-e500-4267-9d27-3bf1300c8143 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:37.557179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001adefd-0af8-4af4-a53f-6c6052db4d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:37.557829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001adefd-0af8-4af4-a53f-6c6052db4d2e service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:37.558119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001adefd-0af8-4af4-a53f-6c6052db4d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:37.558477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001adefd-0af8-4af4-a53f-6c6052db4d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:37.587081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001adefd-0af8-4af4-a53f-6c6052db4d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:37.587081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001adefd-0af8-4af4-a53f-6c6052db4d2e service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:37.598425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1309/2610] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:38.472314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:38.472882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:38.505793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb53f2b-31a1-4d94-aade-38ae248f86a9 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:38.511506 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:38.512152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:38.512434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:38.512705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] PATH_INFO: `/v3/projects/600c3a7f1074427eb47384378c39704a` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:38.522827 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600c3a7f1074427eb47384378c39704a)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:38.524781 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:38.722844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:38.724712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600c3a7f1074427eb47384378c39704a', 'request_id': 'req-afd1a977-9814-4a3e-95f9-4c66c80607a4'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:38.731920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600c3a7f1074427eb47384378c39704a', 'request_id': 'req-afd1a977-9814-4a3e-95f9-4c66c80607a4'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:38.738492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600c3a7f1074427eb47384378c39704a', 'request_id': 'req-afd1a977-9814-4a3e-95f9-4c66c80607a4'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:38.811706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] The token cache is being invalidate because project 600c3a7f1074427eb47384378c39704a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:38.812157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:38.813697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-afd1a977-9814-4a3e-95f9-4c66c80607a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:38.815289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1302/2611] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:38 2022] DELETE /identity/v3/projects/600c3a7f1074427eb47384378c39704a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:38.821964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:38.822521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:38.822521 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:38.848850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:38.850261 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:38.964736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1310/2612] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:38.965008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:38.965008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:38.965337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.058762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:39.058762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:39.058762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1303/2613] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:39.072829 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:39.086782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5aee-c71f-445b-8498-c1d0b115e71b None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:39.093058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:39.093869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.094266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.094651 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.095421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:39.095858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:39.099817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:39.134239 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1311/2614] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:39.138714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:39.149382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebddc4-bae3-42c2-ade0-0640308fb6d3 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:39.165020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:39.167075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.167075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.167075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.167075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:39.168832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:39.299621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1304/2615] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:39.304444 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:39.314631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a17ce-b58e-4708-814a-65e8b7375ab1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:39.373505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:39.374146 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.374435 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.374719 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.375322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:39.377251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:39.471320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1312/2616] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:39 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:39.475365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:39.487880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41798-766b-4500-a067-c5e66a76f040 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:39.496197 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:39.499667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.499667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.499667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.499667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:39.500183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:39.512228 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1305/2617] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:39.516604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:39.528059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6df6-dd70-4c77-9bc5-5aff659a1c28 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:39.534060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63607efc-94ae-443b-83b8-fae8d80ec7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:39.534060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63607efc-94ae-443b-83b8-fae8d80ec7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.534060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63607efc-94ae-443b-83b8-fae8d80ec7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.534391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63607efc-94ae-443b-83b8-fae8d80ec7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.534770 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63607efc-94ae-443b-83b8-fae8d80ec7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:39.536536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63607efc-94ae-443b-83b8-fae8d80ec7c2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:39.547792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1313/2618] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:39.551977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:39.563690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138749e-e4bb-40cf-a12f-4206188b44d4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:39.570071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:39.570793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.571126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.571417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] PATH_INFO: `/v3/projects/5b6317832caa45e6bdf00d94fbf2e1c3/users/8cdd40d728fe4e889b4591f46bef0a8a/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.588894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6317832caa45e6bdf00d94fbf2e1c3, user_id=8cdd40d728fe4e889b4591f46bef0a8a, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:39.591837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:39.715309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1306/2619] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:39 2022] PUT /identity/v3/projects/5b6317832caa45e6bdf00d94fbf2e1c3/users/8cdd40d728fe4e889b4591f46bef0a8a/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:39.726224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:39.726514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:39.726790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:39.757225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] MFA Rules not processed for user `8cdd40d728fe4e889b4591f46bef0a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:39.758527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:39.781158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:39.832425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1314/2620] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:39.836967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.026630 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49d209-0a9a-4cb4-9ef7-7f2edb314a49 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.032252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.033904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.033904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.033904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.034231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.036008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.167095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1307/2621] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:39 2022] POST /identity/v3/projects => generated 367 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:40.168305 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.180212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffebec-f492-4daa-abd8-1149ea26d301 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.237824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.238612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.238893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.239164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.239793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.242464 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.375758 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1315/2622] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:40 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:40.379624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.396364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a191-43cc-4b58-af5b-fab82fb4fefe admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.403711 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.404871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.405298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.405885 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.414223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.414223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.424343 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1308/2623] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:40.426099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.443957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ca9a3-d28e-4bfd-9588-3d3815ba7c1a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.451176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.464723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.465244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.466696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] PATH_INFO: `/v3/projects/bbe560e887494326bcadeeb1e0edeca7/users/858234f8177942f68de868f460d2a368/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.495021 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe560e887494326bcadeeb1e0edeca7, user_id=858234f8177942f68de868f460d2a368, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.501489 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.580809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1316/2624] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:40 2022] PUT /identity/v3/projects/bbe560e887494326bcadeeb1e0edeca7/users/858234f8177942f68de868f460d2a368/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:57:40.585527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.606068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3b411-5767-4742-9a72-bd3239b2c2d6 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.661103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:40.674106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6753-9fbc-4269-950d-a782b91a66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.674773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6753-9fbc-4269-950d-a782b91a66b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.675052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6753-9fbc-4269-950d-a782b91a66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.675322 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6753-9fbc-4269-950d-a782b91a66b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.675969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f6753-9fbc-4269-950d-a782b91a66b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.677603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f6753-9fbc-4269-950d-a782b91a66b2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.688180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1309/2625] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:40.692354 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.703116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742307b0-d8ff-47a4-b22b-084761692cd6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.708055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.709425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.709425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.709821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] PATH_INFO: `/v3/projects/bbe560e887494326bcadeeb1e0edeca7/users/858234f8177942f68de868f460d2a368/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.711814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe560e887494326bcadeeb1e0edeca7, user_id=858234f8177942f68de868f460d2a368, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.714550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.725574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1317/2626] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:40 2022] PUT /identity/v3/projects/bbe560e887494326bcadeeb1e0edeca7/users/858234f8177942f68de868f460d2a368/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:40.737456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.737799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.738157 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.766261 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] MFA Rules not processed for user `858234f8177942f68de868f460d2a368`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:40.767505 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:40.848206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1310/2627] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:40.861147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:40.862922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:40.924043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bb568-7d04-445f-910e-af5821e176e1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:40.930205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477adc9-582f-4ad8-8d35-af9a833d49a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:40.930205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477adc9-582f-4ad8-8d35-af9a833d49a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:40.930205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477adc9-582f-4ad8-8d35-af9a833d49a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:40.930205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477adc9-582f-4ad8-8d35-af9a833d49a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:40.942161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477adc9-582f-4ad8-8d35-af9a833d49a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:40.948230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477adc9-582f-4ad8-8d35-af9a833d49a0 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:40.955793 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1318/2628] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:41.115031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:41.116975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:41.132451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ede174-d299-453e-889c-2256d19d8778 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:41.136282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:41.137065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:41.137423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:41.137793 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:41.207215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:41.208297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:41.224850 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1311/2629] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:44.171927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:44.173308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:44.174034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:44.216821 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] MFA Rules not processed for user `9e4f4a622faa41f3a996fdefffd09361`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:44.227968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:44.235498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:44.312691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1319/2630] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:44.318020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:44.319604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:44.400143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba345c-0ce2-4cda-86de-e05ae6cbfb01 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:44.405495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:44.407177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:44.407177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:44.407177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:44.407899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:44.411009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:44.425460 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:44.717464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1312/2631] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:44 2022] POST /identity/v3/projects => generated 373 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:44.721899 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:44.736493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b477b4-8112-4861-8182-58f8fe24eaf5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:44.802801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:44.803125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:44.803407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:44.803684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:44.804309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:44.806426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:44.922920 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1320/2632] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:44 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:44.926875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:44.939741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cf3ae-25b0-4380-83b2-1394f6be82fa admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:44.945285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:44.945931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:44.946248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:44.946521 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:44.947164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:44.948768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:44.960127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1313/2633] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:44.964056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:44.976351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe971cf-aa8d-4cbf-9523-26e771e99917 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:44.981289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:44.982153 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:44.982515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:44.982849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] PATH_INFO: `/v3/projects/3b20f3bbe2f54f53991f2f68456aae54/users/a083fbbd953d4ce19157568cdc4d556d/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:45.001058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b20f3bbe2f54f53991f2f68456aae54, user_id=a083fbbd953d4ce19157568cdc4d556d, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:45.004191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:45.130353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1321/2634] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:44 2022] PUT /identity/v3/projects/3b20f3bbe2f54f53991f2f68456aae54/users/a083fbbd953d4ce19157568cdc4d556d/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:45.134583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:45.145579 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36456bee-fc1c-4aec-acfd-ff005e970cfb admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:45.212319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:45.213015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:45.213300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:45.213572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:45.214270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:45.219921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:45.234387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1314/2635] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:57:45.235379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:45.247495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce02bba-988c-4b4e-8616-325816f3cb82 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:45.253721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c0865-12c3-4e9d-98d6-de03916fa049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:45.254998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0865-12c3-4e9d-98d6-de03916fa049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:45.255644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0865-12c3-4e9d-98d6-de03916fa049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:45.256090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0865-12c3-4e9d-98d6-de03916fa049 admin admin] PATH_INFO: `/v3/projects/3b20f3bbe2f54f53991f2f68456aae54/users/a083fbbd953d4ce19157568cdc4d556d/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:45.258783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c0865-12c3-4e9d-98d6-de03916fa049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b20f3bbe2f54f53991f2f68456aae54, user_id=a083fbbd953d4ce19157568cdc4d556d, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:45.261577 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c0865-12c3-4e9d-98d6-de03916fa049 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:45.280792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1322/2636] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:45 2022] PUT /identity/v3/projects/3b20f3bbe2f54f53991f2f68456aae54/users/a083fbbd953d4ce19157568cdc4d556d/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:47.561396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:47.573051 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ec230-3a2c-4716-bbed-1dc0f1d841fd admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:47.659605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:47.660597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:47.660890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:47.661170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] PATH_INFO: `/v3/users/8cdd40d728fe4e889b4591f46bef0a8a` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:47.663006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdd40d728fe4e889b4591f46bef0a8a)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:47.665297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:47.853110 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdd40d728fe4e889b4591f46bef0a8a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:47.854006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdd40d728fe4e889b4591f46bef0a8a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:47.854886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdd40d728fe4e889b4591f46bef0a8a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:47.869412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdd40d728fe4e889b4591f46bef0a8a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:47.884352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:47.977956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdd40d728fe4e889b4591f46bef0a8a'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:48.000028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:48.000503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:48.000588 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:48.003770 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1315/2637] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:47 2022] DELETE /identity/v3/users/8cdd40d728fe4e889b4591f46bef0a8a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:48.024927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:48.026339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:48.106406 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:48.115991 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1323/2638] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:48.128708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:48.130983 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:48.212644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440444f-2522-4ed6-b6c4-0da056e96451 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:48.216578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:48.217226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:48.217511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:48.217823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:48.227856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:48.229431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:48.242152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1316/2639] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:48.780872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:48.782717 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:48.796308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a1074-dcba-49b6-8861-69d3f4dffeb5 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:48.808103 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:48.809408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:48.810240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:48.812967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] PATH_INFO: `/v3/projects/5b6317832caa45e6bdf00d94fbf2e1c3` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:48.815484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6317832caa45e6bdf00d94fbf2e1c3)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:48.820090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:49.043173 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6317832caa45e6bdf00d94fbf2e1c3', 'request_id': 'req-c3687f4d-3339-44f7-afcf-584c28b47d17'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.049584 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6317832caa45e6bdf00d94fbf2e1c3', 'request_id': 'req-c3687f4d-3339-44f7-afcf-584c28b47d17'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.110318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6317832caa45e6bdf00d94fbf2e1c3', 'request_id': 'req-c3687f4d-3339-44f7-afcf-584c28b47d17'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.127396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] The token cache is being invalidate because project 5b6317832caa45e6bdf00d94fbf2e1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:49.127980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.130052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.132967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1324/2640] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:48 2022] DELETE /identity/v3/projects/5b6317832caa45e6bdf00d94fbf2e1c3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:49.136740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:49.149739 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0a3f-3245-4412-8f08-c9b46e492ab7 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:49.222975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:49.223830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:49.224930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:49.225279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] PATH_INFO: `/v3/users/858234f8177942f68de868f460d2a368` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:49.226597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=858234f8177942f68de868f460d2a368)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:49.228826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:49.462751 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858234f8177942f68de868f460d2a368'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.463472 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858234f8177942f68de868f460d2a368'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.464561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858234f8177942f68de868f460d2a368'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.488304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858234f8177942f68de868f460d2a368'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.564483 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-2cd378c4-f683-4c5a-a5d4-01caaebf3025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858234f8177942f68de868f460d2a368'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:49.590101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1317/2641] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:49 2022] DELETE /identity/v3/users/858234f8177942f68de868f460d2a368 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:57:50.982884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:50.985272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:51.001425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3687f4d-3339-44f7-afcf-584c28b47d17 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.070448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.071094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.071404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.071679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] PATH_INFO: `/v3/projects/bbe560e887494326bcadeeb1e0edeca7` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.072817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe560e887494326bcadeeb1e0edeca7)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.074780 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:51.203734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe560e887494326bcadeeb1e0edeca7', 'request_id': 'req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.212559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe560e887494326bcadeeb1e0edeca7', 'request_id': 'req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.291508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe560e887494326bcadeeb1e0edeca7', 'request_id': 'req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.313748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] The token cache is being invalidate because project bbe560e887494326bcadeeb1e0edeca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:51.313748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.313748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-d2e8ee96-8d4b-42b5-9c9f-fe9bc2787740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:51.314321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1325/2642] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:50 2022] DELETE /identity/v3/projects/bbe560e887494326bcadeeb1e0edeca7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:51.319158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.319627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.319819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.353464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:51.354809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:51.359768 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:51.464284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1318/2643] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:51.472957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.473737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.474809 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.513633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:51.513633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:51.516659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1326/2644] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:51.520645 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:51.535457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570d41-e356-4439-9909-661bc204c8dc None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.541226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.542354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.542790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.543512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.544390 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:51.544694 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.546357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:51.576354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1319/2645] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:51.580383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:51.594886 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580edcbc-f613-4583-9c90-c269a7b2d7b4 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.600582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.602752 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.603221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.603669 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.604652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.607416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:51.613134 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:51.764877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1327/2646] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:51 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:51.766065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:51.778601 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d171-40ff-4212-a582-20ded2f8f614 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.850086 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.850714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.851084 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.851371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.852305 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.854396 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:51.969061 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1320/2647] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:51 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:51.970933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:51.982747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d951bbf-c01b-4546-a725-331d85ce79c0 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:51.989549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:51.990429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:51.991033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:51.991433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:51.992262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:51.994914 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.010994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1328/2648] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:52.012420 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.023608 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f005-136f-45cb-b073-fbe3e4675d49 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.029833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c766d-173b-4db1-b328-274df6fc45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.030462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c766d-173b-4db1-b328-274df6fc45b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.030745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c766d-173b-4db1-b328-274df6fc45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.031016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c766d-173b-4db1-b328-274df6fc45b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.031935 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c766d-173b-4db1-b328-274df6fc45b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.033546 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c766d-173b-4db1-b328-274df6fc45b9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.049452 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1321/2649] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:57:52.050731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.064498 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c3604-524d-424a-9f1f-35741efd754b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.069667 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.070518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.070798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.071074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] PATH_INFO: `/v3/projects/e2ed057deefb483da35db3c2bcef77a8/users/3e6dde270989462f879fa964c07fc9d7/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.088439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ed057deefb483da35db3c2bcef77a8, user_id=3e6dde270989462f879fa964c07fc9d7, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.091733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.160479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1329/2650] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:52 2022] PUT /identity/v3/projects/e2ed057deefb483da35db3c2bcef77a8/users/3e6dde270989462f879fa964c07fc9d7/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:52.171515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb609f3-6464-449b-b29a-7022ac296fd0 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.171845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb609f3-6464-449b-b29a-7022ac296fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.172158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb609f3-6464-449b-b29a-7022ac296fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.202335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fdb609f3-6464-449b-b29a-7022ac296fd0 None None] MFA Rules not processed for user `3e6dde270989462f879fa964c07fc9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:52.209377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fdb609f3-6464-449b-b29a-7022ac296fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.297724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1322/2651] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:52.302136 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.376251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f10940-3f59-4ee9-a46b-4a72bad03392 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.382140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.382941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.383321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.383700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.384496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.386645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.443262 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.447105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.447105 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.452044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:52.474496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] MFA Rules not processed for user `a083fbbd953d4ce19157568cdc4d556d`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:52.475931 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.517024 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1330/2652] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:52 2022] POST /identity/v3/projects => generated 389 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:52.520298 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.551798 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1323/2653] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:52.567143 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.569545 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.585537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5ae06-b25f-4e59-b209-629f6c198dbb admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.590890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.591507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.591792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.592060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.592693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.595421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.649275 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2b8b3-93d9-4f37-9e02-20a865720e14 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.714967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1331/2654] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:52 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:57:52.716493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.719549 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.720169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.720456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.720734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.725121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.730189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22deb46-a425-4787-98b3-60583ac1cb3b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.735933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197403-9a62-4aa6-94fd-77c139f27eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.736653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197403-9a62-4aa6-94fd-77c139f27eab admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.736938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197403-9a62-4aa6-94fd-77c139f27eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.737212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197403-9a62-4aa6-94fd-77c139f27eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.737979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197403-9a62-4aa6-94fd-77c139f27eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.739563 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197403-9a62-4aa6-94fd-77c139f27eab admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.750594 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1332/2655] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:52.751638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.753696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.753696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.771482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:52.772711 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.783936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:52.791894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.793600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.803941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1324/2656] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:52.804856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.815609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc5540-0767-4084-9669-3f5e36fd305e service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.820667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:52.836361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:52.836361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:52.836361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] PATH_INFO: `/v3/projects/548d57a6db8945559b0eac6234f2c734/users/f2a6911187af4822988794b5738486f3/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:52.839859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] RBAC: Authorizing `identity:create_grant(project_id=548d57a6db8945559b0eac6234f2c734, user_id=f2a6911187af4822988794b5738486f3, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:52.840514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1333/2657] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 24 03:57:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:52.842899 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:52.869368 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.870840 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:52.945019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1325/2658] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:52 2022] PUT /identity/v3/projects/548d57a6db8945559b0eac6234f2c734/users/f2a6911187af4822988794b5738486f3/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:52.945649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36f323-11e2-4693-a078-b6bbbdb94c36 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:52.949085 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:52.954802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:53.030952 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:53.031882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:53.032071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ba27d-74df-45f7-aeb4-a19e6526509d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:53.032202 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:53.032386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:53.037610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:53.038330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:53.038743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:53.038919 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:53.039625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:53.042277 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:53.061809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1326/2659] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:53.061809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:53.072156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b37f58b-7f44-403d-ad1a-84f177b87995 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:53.077112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798dd5-4500-4a74-9682-63b7dfb7714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:53.077814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798dd5-4500-4a74-9682-63b7dfb7714d admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:53.078122 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798dd5-4500-4a74-9682-63b7dfb7714d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:53.080963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798dd5-4500-4a74-9682-63b7dfb7714d admin admin] PATH_INFO: `/v3/projects/548d57a6db8945559b0eac6234f2c734/users/f2a6911187af4822988794b5738486f3/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:53.080963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798dd5-4500-4a74-9682-63b7dfb7714d admin admin] RBAC: Authorizing `identity:create_grant(project_id=548d57a6db8945559b0eac6234f2c734, user_id=f2a6911187af4822988794b5738486f3, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:53.083341 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798dd5-4500-4a74-9682-63b7dfb7714d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:53.094713 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1327/2660] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:53 2022] PUT /identity/v3/projects/548d57a6db8945559b0eac6234f2c734/users/f2a6911187af4822988794b5738486f3/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:53.102648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:53.104600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:53.109712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:53.109712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:53.109712 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:53.115100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1334/2661] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:57:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:57:53.145534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] MFA Rules not processed for user `f2a6911187af4822988794b5738486f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:53.147212 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:53.224676 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1328/2662] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:53 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:53.236352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:53.237971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:53.325755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05b58-6690-4a3f-b468-565427b78b4e service swift] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:53.355649 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:53.386349 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ae63a-d9d0-4a71-bb7b-fa3da810f838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:53.387015 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae63a-d9d0-4a71-bb7b-fa3da810f838 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:53.387450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae63a-d9d0-4a71-bb7b-fa3da810f838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:53.387792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ae63a-d9d0-4a71-bb7b-fa3da810f838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:53.398017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae63a-d9d0-4a71-bb7b-fa3da810f838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:53.400500 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ae63a-d9d0-4a71-bb7b-fa3da810f838 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:53.410786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1335/2663] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:53 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:53.601634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:53.610628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:53.678992 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b871e1b-2b6c-49be-bdfb-88adeacad396 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:53.685071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:53.685890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:53.686412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:53.686656 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] PATH_INFO: `/v3/users/3e6dde270989462f879fa964c07fc9d7` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:53.687913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e6dde270989462f879fa964c07fc9d7)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:53.689965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:53.887409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e6dde270989462f879fa964c07fc9d7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:53.888257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e6dde270989462f879fa964c07fc9d7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:53.888838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e6dde270989462f879fa964c07fc9d7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:53.904065 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e6dde270989462f879fa964c07fc9d7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:54.025072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e6dde270989462f879fa964c07fc9d7'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:54.043502 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1329/2664] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:53 2022] DELETE /identity/v3/users/3e6dde270989462f879fa964c07fc9d7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:54.048044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:54.048572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:54.048572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:54.070048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:54.074922 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:54.152405 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1336/2665] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:57:54.164247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:54.165723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:54.257538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b776f7e-dd69-4438-ad76-86f477a6f4bc admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:54.264215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:54.265171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:54.265326 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:54.265599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:54.285311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:54.286891 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:54.301027 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1330/2666] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:57:54.826761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:54.830243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:54.843061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fc8a4-37d7-4616-824a-170a6ee75ab8 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:54.848264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:54.848979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:54.849271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:54.849547 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] PATH_INFO: `/v3/projects/e2ed057deefb483da35db3c2bcef77a8` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:54.856586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ed057deefb483da35db3c2bcef77a8)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:54.858638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:55.018035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ed057deefb483da35db3c2bcef77a8', 'request_id': 'req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.024319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ed057deefb483da35db3c2bcef77a8', 'request_id': 'req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.026965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:55.133900 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ed057deefb483da35db3c2bcef77a8', 'request_id': 'req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.145670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] The token cache is being invalidate because project e2ed057deefb483da35db3c2bcef77a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:55.146107 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.146826 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.148494 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1337/2667] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:54 2022] DELETE /identity/v3/projects/e2ed057deefb483da35db3c2bcef77a8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:55.153508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:55.167715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5cd4e1-72ae-4b43-a87b-7271ee454b56 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:55.205265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:55.244330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:55.245880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:55.246649 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:55.247152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] PATH_INFO: `/v3/users/f2a6911187af4822988794b5738486f3` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:55.248884 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a6911187af4822988794b5738486f3)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:55.251449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:55.525043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a6911187af4822988794b5738486f3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.526337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a6911187af4822988794b5738486f3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.527620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a6911187af4822988794b5738486f3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.551082 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a6911187af4822988794b5738486f3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.674347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-3ac7826e-eb91-4e2e-8294-601c776d66c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a6911187af4822988794b5738486f3'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:55.696457 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1331/2668] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:57:55 2022] DELETE /identity/v3/users/f2a6911187af4822988794b5738486f3 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:56.233056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:56.235151 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:56.248811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abe51e-65aa-4ac4-840f-72ad8b42dbd2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:56.291882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd239-34e0-41f2-ac41-cce9bbce509a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:56.292381 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd239-34e0-41f2-ac41-cce9bbce509a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:56.292468 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd239-34e0-41f2-ac41-cce9bbce509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:56.315303 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1dffd239-34e0-41f2-ac41-cce9bbce509a None None] MFA Rules not processed for user `9e4f4a622faa41f3a996fdefffd09361`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:56.321818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1dffd239-34e0-41f2-ac41-cce9bbce509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:56.323179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:56.323823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:56.324101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:56.324375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] PATH_INFO: `/v3/projects/548d57a6db8945559b0eac6234f2c734` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:56.325652 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] RBAC: Authorizing `identity:delete_project(project_id=548d57a6db8945559b0eac6234f2c734)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:56.327685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:56.375393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1332/2669] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:56.467311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548d57a6db8945559b0eac6234f2c734', 'request_id': 'req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:56.475463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548d57a6db8945559b0eac6234f2c734', 'request_id': 'req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:56.622407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548d57a6db8945559b0eac6234f2c734', 'request_id': 'req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:56.644268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] The token cache is being invalidate because project 548d57a6db8945559b0eac6234f2c734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:57:56.644470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:56.645317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-63b16a0c-8dfc-4c94-bab0-8ada9fdc851e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:57:56.647995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1338/2670] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:57:56 2022] DELETE /identity/v3/projects/548d57a6db8945559b0eac6234f2c734 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:56.652897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:56.691378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:56.691378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:56.691378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:56.691378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:56.739759 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:56.751354 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1333/2671] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:56.759374 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:56.759734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:56.760088 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:56.780969 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:56.782530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:56.792116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1339/2672] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:56.796569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:56.807094 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e992dd-d08d-44d0-9033-20e2f54b61f3 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:56.811855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:56.812474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:56.812755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:56.813028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:56.813679 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:57:56.814013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:56.815616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:56.830708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1334/2673] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:57:56.837402 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:56.847196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c750c6-165f-47c3-98af-86ca840792b6 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:56.852371 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:56.852986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:56.853286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:56.853553 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:56.856715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:56.858714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:57.015471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1340/2674] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:57:56 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:57.019638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:57.030761 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2099b11-1313-4991-9877-0eea8b6661d4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:57.104490 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:57.105324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:57.105818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:57.106367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:57.107203 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:57.110893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:57.205136 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1335/2675] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:57:57 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:57:57.207408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:57.219252 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44359d-6724-4a1e-8c79-6bd0168eb97c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:57.228683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:57.229610 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:57.229916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:57.230192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:57.234660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:57.234660 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:57.247081 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1341/2676] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:57.248332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:57.259611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706d7e1-5d24-4844-bdc1-77f159d94901 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:57.268329 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2fa9-cacd-44a2-83fe-019f0d8eb4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:57.269050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2fa9-cacd-44a2-83fe-019f0d8eb4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:57.269398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2fa9-cacd-44a2-83fe-019f0d8eb4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:57.269743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2fa9-cacd-44a2-83fe-019f0d8eb4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:57.271244 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2fa9-cacd-44a2-83fe-019f0d8eb4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:57.272788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2fa9-cacd-44a2-83fe-019f0d8eb4f1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:57.285668 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1336/2677] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:57:57.295869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:57.307295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1493-6f27-4d6d-84bd-c8f6c401c383 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:57.312249 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:57.312981 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:57.313328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:57.313671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] PATH_INFO: `/v3/projects/888332a928884bbf80526a0f5bd7f0fc/users/ce6dad8218c046ec9f91eb89f9ac5824/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:57.331130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=888332a928884bbf80526a0f5bd7f0fc, user_id=ce6dad8218c046ec9f91eb89f9ac5824, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:57.334534 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:57.464311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1342/2678] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:57:57 2022] PUT /identity/v3/projects/888332a928884bbf80526a0f5bd7f0fc/users/ce6dad8218c046ec9f91eb89f9ac5824/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:57:57.469580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962885ff-38b9-4977-9541-f7567d164007 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:57.470152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962885ff-38b9-4977-9541-f7567d164007 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:57.470152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962885ff-38b9-4977-9541-f7567d164007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:57.506139 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-962885ff-38b9-4977-9541-f7567d164007 None None] MFA Rules not processed for user `ce6dad8218c046ec9f91eb89f9ac5824`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:57:57.507801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-962885ff-38b9-4977-9541-f7567d164007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:57.581924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1337/2679] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:57:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:57:57.594212 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:57:57.596436 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:57:57.617909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:57:57.665127 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2b921-f49d-4a1d-ac24-71ae8f67fb06 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:57:57.669281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:57:57.670213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:57:57.670213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:57:57.670473 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:57:57.679266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:57:57.680704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:57:57.690554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1343/2680] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:57:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:05.804141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962885ff-38b9-4977-9541-f7567d164007 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:05.805788 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-962885ff-38b9-4977-9541-f7567d164007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:05.865844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962885ff-38b9-4977-9541-f7567d164007 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:05.869527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:05.870172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:05.870427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:05.870696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:05.872635 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:05.877844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:05.945369 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:05.946846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:05.958948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1338/2681] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:08.445407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:08.446933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:08.463262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efaa2a-fd59-4ae5-bc95-5cdc87531a35 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:08.467002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:08.467567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:08.467880 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:08.468154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:08.474771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:08.493026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:08.494555 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:08.507822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1344/2682] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:14.965728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:14.975394 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be09763-8e0d-4040-8f25-6f17d29d1e2f service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:14.979442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:14.980055 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:14.980338 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:14.980615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:14.982399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:15.047247 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:15.048693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:15.059535 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1339/2683] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:17.853545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:17.862503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a394f-e03c-44e9-92aa-7a4e7934ecf2 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:17.866312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:17.866988 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:17.867273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:17.867585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:17.869358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:17.880450 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:17.882049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:17.891058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1345/2684] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:18.892528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:18.893896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:18.986881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316e7de-14e2-4eb5-b4d0-194395debec9 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:18.991576 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:18.992316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:18.992597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:18.993005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:18.994836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:19.008807 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:19.010123 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:19.024172 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1340/2685] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:19.026844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:19.028497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:19.048864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f141f1e-7919-4cac-bd27-695bd41fbc76 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:19.054366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:19.059645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:19.059645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:19.059645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] PATH_INFO: `/v3/users/a7a6eb1ae2eb4110b6bd689740769aee` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:19.071790 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a6eb1ae2eb4110b6bd689740769aee)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:19.073993 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:19.230378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a6eb1ae2eb4110b6bd689740769aee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.231087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a6eb1ae2eb4110b6bd689740769aee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.232046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a6eb1ae2eb4110b6bd689740769aee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.246115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a6eb1ae2eb4110b6bd689740769aee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.348397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-68021c63-b8ae-4b80-9442-bc3c107b4d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a6eb1ae2eb4110b6bd689740769aee'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.362018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1346/2686] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:19 2022] DELETE /identity/v3/users/a7a6eb1ae2eb4110b6bd689740769aee => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:19.638003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:19.649896 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c691ec-face-4211-a61e-03f9393dfa9e service placement] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:19.666473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:19.727083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:19.727083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:19.727083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:19.727083 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] PATH_INFO: `/v3/projects/94cd09760dc94db4a0f44712fe41d3e6` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:19.732814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=94cd09760dc94db4a0f44712fe41d3e6)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:19.734836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:19.869010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94cd09760dc94db4a0f44712fe41d3e6', 'request_id': 'req-7c05b68c-1178-473a-b993-185d5418c2dd'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.876473 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94cd09760dc94db4a0f44712fe41d3e6', 'request_id': 'req-7c05b68c-1178-473a-b993-185d5418c2dd'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:19.882173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94cd09760dc94db4a0f44712fe41d3e6', 'request_id': 'req-7c05b68c-1178-473a-b993-185d5418c2dd'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:20.004800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] The token cache is being invalidate because project 94cd09760dc94db4a0f44712fe41d3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:20.005934 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:20.006606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-7c05b68c-1178-473a-b993-185d5418c2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:20.008242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1341/2687] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:19 2022] DELETE /identity/v3/projects/94cd09760dc94db4a0f44712fe41d3e6 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:20.013938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.014227 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.019471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.036550 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:20.037962 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:20.092630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:20.108331 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1347/2688] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:58:20.116066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.116353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.116629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.137190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:20.145471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:20.146830 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1342/2689] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:20.151180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.161275 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbee79-9bce-4e4a-91f0-2fee68984d56 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.165936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.166542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.166827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.167101 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.167743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:58:20.168047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.169641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.181852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1348/2690] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 03:58:20.186547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.197091 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e49e7-3a13-4a59-b128-7075ccc037b1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.201970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.202569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.202859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.203132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.203757 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.205690 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.299380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1343/2691] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:20 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:20.303753 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.313589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f9662-135f-406a-9b47-c02d415a1cf3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.370726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.371338 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.371620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.371896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.372515 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.374504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.459403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1349/2692] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:20 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:20.463978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.474644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e6f6d-a360-4074-aacd-114cc6dafb58 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.479776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.480512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.480858 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.481141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.481918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.483618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.494639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1344/2693] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:20.498709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.509836 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373ff30-6734-408a-ae59-4aa7a4bbb5b5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.515393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8165d-3fab-46ac-b44b-3e51384fbc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.516028 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8165d-3fab-46ac-b44b-3e51384fbc5f admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.516312 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8165d-3fab-46ac-b44b-3e51384fbc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.516586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8165d-3fab-46ac-b44b-3e51384fbc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.517285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8165d-3fab-46ac-b44b-3e51384fbc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.518973 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8165d-3fab-46ac-b44b-3e51384fbc5f admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.531274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1350/2694] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:20.535350 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.545416 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b213a-e683-4372-a32e-cf04b5ab8152 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.554475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.555140 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.555427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.555684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] PATH_INFO: `/v3/projects/6c073edfb4524a57954c956df76d267a/users/ec6716fcf5e74b06b9cc143f45131d4e/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.573734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c073edfb4524a57954c956df76d267a, user_id=ec6716fcf5e74b06b9cc143f45131d4e, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.576435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.744423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1345/2695] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:20 2022] PUT /identity/v3/projects/6c073edfb4524a57954c956df76d267a/users/ec6716fcf5e74b06b9cc143f45131d4e/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:20.755907 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.756123 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.756364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.786385 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] MFA Rules not processed for user `ec6716fcf5e74b06b9cc143f45131d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:20.787599 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:20.856703 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1351/2696] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:20.868838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:20.870675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:20.907171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:20.948675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582d24e-0e57-4d6a-9a3f-92df85167c07 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:20.954988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:20.955607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:20.955890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:20.956164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:20.965410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:20.967038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:20.976604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1346/2697] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:23.237483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:23.239242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:23.239700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:23.241185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:23.293297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:23.305221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfca3df-b519-49ea-aff2-75464908fb5a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:23.309321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:23.309972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:23.310255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:23.310527 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:23.312510 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:23.315620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ddbbb-1a89-45c0-87db-5c5ddfc8665a service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:23.324665 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:23.328744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:23.328744 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:23.329207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:23.329435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] PATH_INFO: `/v3/users/ce6dad8218c046ec9f91eb89f9ac5824` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:23.329435 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6dad8218c046ec9f91eb89f9ac5824)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:23.329754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1af88-ef15-4e6b-8f1c-705df2adcd47 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:23.330043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:23.345970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1352/2698] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:23.534857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6dad8218c046ec9f91eb89f9ac5824'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:23.535613 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6dad8218c046ec9f91eb89f9ac5824'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:23.536240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6dad8218c046ec9f91eb89f9ac5824'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:23.550449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6dad8218c046ec9f91eb89f9ac5824'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:23.698192 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6dad8218c046ec9f91eb89f9ac5824'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:23.712294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1347/2699] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:23 2022] DELETE /identity/v3/users/ce6dad8218c046ec9f91eb89f9ac5824 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:58:23.717487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:23.717800 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:23.718060 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:23.739774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:23.739774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:23.797597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1353/2700] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:58:23.807787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:23.809220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:23.854315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:23.872486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b0eb2-e616-4b4a-b131-3e393cc6bf52 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:23.876422 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac3f13-1b77-48d2-bc1d-c2337965bb13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:23.877181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3f13-1b77-48d2-bc1d-c2337965bb13 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:23.877401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3f13-1b77-48d2-bc1d-c2337965bb13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:23.877678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac3f13-1b77-48d2-bc1d-c2337965bb13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:23.887365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac3f13-1b77-48d2-bc1d-c2337965bb13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:23.888929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac3f13-1b77-48d2-bc1d-c2337965bb13 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:23.899401 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1348/2701] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:24.509804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:24.511551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:24.532744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decce9-1be0-4219-926b-f5ceccf3c958 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:24.538739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:24.540058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:24.540417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:24.541031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] PATH_INFO: `/v3/projects/888332a928884bbf80526a0f5bd7f0fc` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:24.542681 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=888332a928884bbf80526a0f5bd7f0fc)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:24.544675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:24.703169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888332a928884bbf80526a0f5bd7f0fc', 'request_id': 'req-535f430e-ff48-40b4-ae12-0a637ed36027'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:24.721119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888332a928884bbf80526a0f5bd7f0fc', 'request_id': 'req-535f430e-ff48-40b4-ae12-0a637ed36027'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:24.829375 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888332a928884bbf80526a0f5bd7f0fc', 'request_id': 'req-535f430e-ff48-40b4-ae12-0a637ed36027'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:24.841928 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] The token cache is being invalidate because project 888332a928884bbf80526a0f5bd7f0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:24.842208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:24.842883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-535f430e-ff48-40b4-ae12-0a637ed36027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:24.844625 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1354/2702] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:24 2022] DELETE /identity/v3/projects/888332a928884bbf80526a0f5bd7f0fc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:24.849318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:24.849868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:24.850134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:24.870819 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:24.872127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:24.934772 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1349/2703] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:24.943242 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:24.943528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:24.943804 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:24.963848 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:24.970430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:24.973403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1355/2704] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:24.977689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:24.987812 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de03aa9-c0e9-46af-a9e1-1c4943763096 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:24.993160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:24.993714 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:24.994076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:24.994359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:24.995022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:58:24.995330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:24.996943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.014735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1350/2705] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:58:25.019251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:25.029987 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a03f7-3efa-4621-97b2-5395d1b97e76 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:25.035439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:25.036121 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.036322 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.036583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.037198 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:25.039245 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.122994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1356/2706] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:25 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:25.127292 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:25.138558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9379e-09c6-4423-a086-2b168e45b1a2 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:25.200302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:25.200967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.201252 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.201552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.202282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:25.204316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.356921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1351/2707] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:25 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:25.361018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:25.373654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981fc8b-a9ee-4561-a5c0-f60433324130 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:25.381575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:25.382657 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.383155 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.383917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.384849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:25.387755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.399769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1357/2708] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:25.403164 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:25.414215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080edb6-5182-47e6-9073-8ad5d1d2a89d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:25.418954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b8481-3542-4d19-a37d-e17b85d940ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:25.419558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b8481-3542-4d19-a37d-e17b85d940ec admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.419843 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b8481-3542-4d19-a37d-e17b85d940ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.420120 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b8481-3542-4d19-a37d-e17b85d940ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.420764 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b8481-3542-4d19-a37d-e17b85d940ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:25.422437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b8481-3542-4d19-a37d-e17b85d940ec admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.433518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1352/2709] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:25.437731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:25.448559 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955e7bd-2a34-42e9-a8aa-04a224ea3bb8 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:25.453481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:25.454182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.454470 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.454769 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] PATH_INFO: `/v3/projects/352afa78d46040e89b12b5e47730b80d/users/50229be4f4084a2e9a4fc55d0c2480a0/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.469985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352afa78d46040e89b12b5e47730b80d, user_id=50229be4f4084a2e9a4fc55d0c2480a0, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:25.473379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.593823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1358/2710] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:25 2022] PUT /identity/v3/projects/352afa78d46040e89b12b5e47730b80d/users/50229be4f4084a2e9a4fc55d0c2480a0/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:25.605044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.611534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.611534 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.633963 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] MFA Rules not processed for user `50229be4f4084a2e9a4fc55d0c2480a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:25.635176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:25.668395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:25.699410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1353/2711] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:25.711468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:25.715831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:25.723884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:25.795943 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820edb6-b3ea-4945-8187-224378fad9b1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:25.799850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34237ba4-78a0-4fb6-82f8-56a8456817ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc5b05e5e96a4afc95ab176576b92577', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:25.800466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34237ba4-78a0-4fb6-82f8-56a8456817ca service glance] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:25.800994 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34237ba4-78a0-4fb6-82f8-56a8456817ca service glance] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:25.801282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34237ba4-78a0-4fb6-82f8-56a8456817ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:25.810104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34237ba4-78a0-4fb6-82f8-56a8456817ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:25.811592 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34237ba4-78a0-4fb6-82f8-56a8456817ca service glance] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:25.820693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1359/2712] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:28.630325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:28.630325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:28.706582 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b43f94-2bf8-40a5-af59-b59c5ec021fa None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:28.712588 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:28.716467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:28.716467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:28.716467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] PATH_INFO: `/v3/users/ec6716fcf5e74b06b9cc143f45131d4e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:28.716467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6716fcf5e74b06b9cc143f45131d4e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:28.718808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:28.932345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6716fcf5e74b06b9cc143f45131d4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:28.933002 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6716fcf5e74b06b9cc143f45131d4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:28.933620 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6716fcf5e74b06b9cc143f45131d4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:28.946057 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6716fcf5e74b06b9cc143f45131d4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:29.045988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6716fcf5e74b06b9cc143f45131d4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:29.067829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1354/2713] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:28 2022] DELETE /identity/v3/users/ec6716fcf5e74b06b9cc143f45131d4e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:29.074437 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:29.075019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:29.075281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:29.098712 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:29.099955 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:29.167706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1360/2714] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:29.177756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:29.179324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:29.237427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4c09f-b1d9-4cd7-8656-680d40b17090 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:29.241037 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971a370-66e0-4c07-9656-35644a53f2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:29.241644 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a370-66e0-4c07-9656-35644a53f2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:29.241965 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a370-66e0-4c07-9656-35644a53f2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:29.242241 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971a370-66e0-4c07-9656-35644a53f2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:29.251180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a370-66e0-4c07-9656-35644a53f2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:29.252723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971a370-66e0-4c07-9656-35644a53f2b1 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:29.257173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:29.263276 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1355/2715] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:29.825549 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:29.827408 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:29.841608 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef804076-6e67-4064-bc79-b98662d1a7c2 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:29.846701 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:29.847921 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:29.848214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:29.848487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] PATH_INFO: `/v3/projects/6c073edfb4524a57954c956df76d267a` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:29.849620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c073edfb4524a57954c956df76d267a)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:29.851575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:29.983535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c073edfb4524a57954c956df76d267a', 'request_id': 'req-e151f0fd-71c1-4b89-823f-c4b28c6f86be'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:29.990761 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c073edfb4524a57954c956df76d267a', 'request_id': 'req-e151f0fd-71c1-4b89-823f-c4b28c6f86be'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:30.090052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c073edfb4524a57954c956df76d267a', 'request_id': 'req-e151f0fd-71c1-4b89-823f-c4b28c6f86be'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:30.110639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] The token cache is being invalidate because project 6c073edfb4524a57954c956df76d267a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:30.111002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:30.111841 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-e151f0fd-71c1-4b89-823f-c4b28c6f86be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:30.116286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1361/2716] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:29 2022] DELETE /identity/v3/projects/6c073edfb4524a57954c956df76d267a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:30.120467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.120467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.120467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.141520 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:30.142785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:30.207367 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1356/2717] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:30.216477 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.216766 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.217044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.237166 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:30.238440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:30.246825 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1362/2718] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:30.252799 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:30.266385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012531c-eae3-4e19-8953-32f4e0e3c275 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:30.272117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:30.272877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.273137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.273405 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.274101 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:58:30.274403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:30.275989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:30.289510 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1357/2719] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:58:30.294183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:30.304029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2cb5-4c64-42b3-a499-6b69e97ab9fb None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:30.309091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:30.309783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.310041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.310347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.310974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:30.312877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:30.317628 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:30.434978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1363/2720] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:30 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:30.439462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:30.450417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d95d5-1296-48b7-9212-85b956e87c8e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:30.509318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:30.509956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.510242 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.510532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.511144 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:30.513100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:30.737475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1358/2721] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:30 2022] POST /identity/v3/users => generated 284 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:30.741512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:30.751857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2e27-3fff-486c-9654-9c6ec30ee79c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:30.756999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:30.757608 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.757923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.758200 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.758858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:30.761476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:30.772372 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1364/2722] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:30.776857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:30.787121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1a623-b8f1-4808-87dd-fb8dd1c4c64a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:30.791821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d638f-db56-470b-a37e-6a2b0c543a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:30.792426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d638f-db56-470b-a37e-6a2b0c543a8a admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.792732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d638f-db56-470b-a37e-6a2b0c543a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.793010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d638f-db56-470b-a37e-6a2b0c543a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.793659 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d638f-db56-470b-a37e-6a2b0c543a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:30.795410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d638f-db56-470b-a37e-6a2b0c543a8a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:30.806683 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1359/2723] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:30.810930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:30.822755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9baf7-59ce-470e-894b-d81e8890fe60 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:30.826798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:30.827466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.827744 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.828018 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] PATH_INFO: `/v3/projects/57d594cdf587448f9b7ff02e27392a1d/users/feb435ba12ad440e8712a1825cd5465f/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.843807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d594cdf587448f9b7ff02e27392a1d, user_id=feb435ba12ad440e8712a1825cd5465f, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:30.846537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:30.959835 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1365/2724] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:30 2022] PUT /identity/v3/projects/57d594cdf587448f9b7ff02e27392a1d/users/feb435ba12ad440e8712a1825cd5465f/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:58:30.970263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:30.970548 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:30.970823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:30.998887 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] MFA Rules not processed for user `feb435ba12ad440e8712a1825cd5465f`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:31.000106 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:31.062655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:31.073491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1360/2725] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:31.085824 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:31.087580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:31.146274 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375482-2b27-4009-b3f9-417a35ebad16 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:31.150140 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:31.150748 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:31.151027 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:31.151299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:31.160218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:31.161682 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:31.171509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1366/2726] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:35.668771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:35.670511 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:35.728602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7ce5b-d199-4506-9a5f-f2ea6c90d0de None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:35.732399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:35.733045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:35.733391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:35.733671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:35.735626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:35.803431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:35.805176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2f368-1516-42e0-9294-b0be225a4296 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:35.815220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1361/2727] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:41.169036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:44.897975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:44.958975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81d82-d0f7-4244-8724-76221711e457 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:44.963519 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:44.964141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:44.964418 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:44.964687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] PATH_INFO: `/v3/users/feb435ba12ad440e8712a1825cd5465f` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:44.965874 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb435ba12ad440e8712a1825cd5465f)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:44.967785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:45.167683 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb435ba12ad440e8712a1825cd5465f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:45.168342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb435ba12ad440e8712a1825cd5465f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:45.168949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb435ba12ad440e8712a1825cd5465f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:45.181504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb435ba12ad440e8712a1825cd5465f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:45.290743 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb435ba12ad440e8712a1825cd5465f'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:45.303718 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1367/2728] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:44 2022] DELETE /identity/v3/users/feb435ba12ad440e8712a1825cd5465f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:45.308325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:45.308836 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:45.308944 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:45.328777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:45.331403 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:45.389797 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1362/2729] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:45.400206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:45.401661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:45.461797 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad4fd3-f9a9-439a-9f74-1f0ed781341c admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:45.465597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1713-e5c0-41e5-abd2-8d41e648c4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:45.466187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1713-e5c0-41e5-abd2-8d41e648c4ba service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:45.471573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1713-e5c0-41e5-abd2-8d41e648c4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:45.471573 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1713-e5c0-41e5-abd2-8d41e648c4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:45.477276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1713-e5c0-41e5-abd2-8d41e648c4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:45.479542 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1713-e5c0-41e5-abd2-8d41e648c4ba service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:45.489695 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1368/2730] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:46.092558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.094071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:46.105948 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33eee78-22d4-44d2-9c67-c4666893dc99 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:46.110696 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:46.111335 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.111609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.111876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] PATH_INFO: `/v3/projects/57d594cdf587448f9b7ff02e27392a1d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.113007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d594cdf587448f9b7ff02e27392a1d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:46.115428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:46.285158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:46.292631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d594cdf587448f9b7ff02e27392a1d', 'request_id': 'req-8d670d69-ca50-49ae-bd9f-e81408a0765e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:46.298968 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d594cdf587448f9b7ff02e27392a1d', 'request_id': 'req-8d670d69-ca50-49ae-bd9f-e81408a0765e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:46.304823 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d594cdf587448f9b7ff02e27392a1d', 'request_id': 'req-8d670d69-ca50-49ae-bd9f-e81408a0765e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:46.422385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] The token cache is being invalidate because project 57d594cdf587448f9b7ff02e27392a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:46.423031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:46.423297 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-8d670d69-ca50-49ae-bd9f-e81408a0765e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:46.424860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1363/2731] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:46 2022] DELETE /identity/v3/projects/57d594cdf587448f9b7ff02e27392a1d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:46.430083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.430545 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.430665 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.450596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:46.451856 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:46.470232 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:46.513602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1369/2732] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:46.522388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.522638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.522911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.543279 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:46.544491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:46.552837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1364/2733] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:46.557244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.568358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1be6c6-baf7-45c5-9f14-b7e275f0ea71 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:46.573053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:46.573670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.573977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.574276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.574927 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:58:46.575230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:46.576822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:46.589168 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1370/2734] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:58:46.593593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.602871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da1fe2-d03a-41fd-b72d-53b23e944465 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:46.607606 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:46.608204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.608484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.608758 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.609377 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:46.611311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:46.709302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1365/2735] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:46 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:46.713480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.723623 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f536-83a8-4d55-8ae8-09315e896d52 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:46.779806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:46.780414 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.780694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.780968 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.781585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:46.783524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:46.908641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1371/2736] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:46 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:46.913373 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.923917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47562bb1-28f0-4ba2-b97e-97a0649f777e admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:46.928617 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:46.929220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.929503 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.929791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.930447 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:46.932043 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:46.942118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1366/2737] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:46.946174 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.956125 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e0ac-381b-42b8-8ed4-f758d99e5d3a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:46.961279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f27db-e9b4-4632-a2a8-bb07c2013410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:46.961838 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f27db-e9b4-4632-a2a8-bb07c2013410 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:46.962120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f27db-e9b4-4632-a2a8-bb07c2013410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:46.962426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f27db-e9b4-4632-a2a8-bb07c2013410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:46.963014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f27db-e9b4-4632-a2a8-bb07c2013410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:46.964638 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f27db-e9b4-4632-a2a8-bb07c2013410 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:46.977039 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1372/2738] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:46.981419 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:46.996632 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a969d9c-03e4-4442-b1cb-3b45dc6b8609 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:47.001415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:47.002115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:47.002399 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:47.002709 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] PATH_INFO: `/v3/projects/a4e7ec5c128647908d9f06e286866dfd/users/695385a0b2e5471ebaab73bf5e5ab429/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:47.017740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e7ec5c128647908d9f06e286866dfd, user_id=695385a0b2e5471ebaab73bf5e5ab429, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:47.020908 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:47.224355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1367/2739] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:46 2022] PUT /identity/v3/projects/a4e7ec5c128647908d9f06e286866dfd/users/695385a0b2e5471ebaab73bf5e5ab429/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:47.235801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:47.236090 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:47.236364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:47.270910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] MFA Rules not processed for user `695385a0b2e5471ebaab73bf5e5ab429`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:47.273492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:47.340421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1373/2740] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:47.345340 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:47.409786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f78baa-7a25-46f4-92fb-9e7d9ec80ec6 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:47.414567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:47.415160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:47.415451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:47.415723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:47.416356 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:47.418486 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:47.611382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1368/2741] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:47 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:47.616011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:47.627882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb6bc-8c9c-4f1d-96fa-53da58a29114 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:47.641621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:47.687130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:47.687746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:47.688031 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:47.688419 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:47.689179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:47.691187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:47.915789 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1374/2742] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:47 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:47.919791 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:47.931019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f610f-d96b-4182-bd6f-8d1e6b790348 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:47.935999 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:47.936618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:47.936898 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:47.937336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:47.938028 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:47.939660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:47.951089 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1369/2743] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:47.955687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:47.966288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce991a1b-150f-4855-8b76-45b749d0fb82 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:47.971253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:47.971970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:47.972250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:47.972524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] PATH_INFO: `/v3/projects/a8405ccf56f44c0ba04a40474724024b/users/22f54de839c84679b21fe01ef2c3cd4e/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:47.988076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8405ccf56f44c0ba04a40474724024b, user_id=22f54de839c84679b21fe01ef2c3cd4e, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:47.993397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:48.131388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1375/2744] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:47 2022] PUT /identity/v3/projects/a8405ccf56f44c0ba04a40474724024b/users/22f54de839c84679b21fe01ef2c3cd4e/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:48.135437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:48.146728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bd083-edf7-4712-b441-c9d7e2d73bad admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:48.181978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:48.204756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f002-0796-4fb9-8251-b533590ac3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:48.205368 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f002-0796-4fb9-8251-b533590ac3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:48.205648 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f002-0796-4fb9-8251-b533590ac3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:48.205977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f002-0796-4fb9-8251-b533590ac3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:48.206643 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7f002-0796-4fb9-8251-b533590ac3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:48.208780 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7f002-0796-4fb9-8251-b533590ac3ab admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:48.218854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1370/2745] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:48.223010 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:48.233959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335194c6-9b3c-41c5-b5d0-effd46c730ff admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:48.238745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:48.239311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:48.239593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:48.239870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] PATH_INFO: `/v3/projects/a8405ccf56f44c0ba04a40474724024b/users/22f54de839c84679b21fe01ef2c3cd4e/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:48.241855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8405ccf56f44c0ba04a40474724024b, user_id=22f54de839c84679b21fe01ef2c3cd4e, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:48.244506 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:48.258122 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1376/2746] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:48 2022] PUT /identity/v3/projects/a8405ccf56f44c0ba04a40474724024b/users/22f54de839c84679b21fe01ef2c3cd4e/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:48.272371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:48.272512 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:48.272785 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:48.302616 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] MFA Rules not processed for user `22f54de839c84679b21fe01ef2c3cd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:48.303868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:48.374003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1371/2747] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:48.385373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:48.387253 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:48.450251 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dba707-8a7f-49aa-808a-06cf8a0df771 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:48.454070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca486c-e7ea-4172-9042-6c6b9e3e8f91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:48.454690 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca486c-e7ea-4172-9042-6c6b9e3e8f91 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:48.454970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca486c-e7ea-4172-9042-6c6b9e3e8f91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:48.455244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca486c-e7ea-4172-9042-6c6b9e3e8f91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:48.465194 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca486c-e7ea-4172-9042-6c6b9e3e8f91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:48.466647 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca486c-e7ea-4172-9042-6c6b9e3e8f91 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:48.480048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1377/2748] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:48.505525 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:48.570465 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d5b23-ae05-45fa-9188-231acb5ebe1c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:48.575642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:48.576286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:48.576569 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:48.576912 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] PATH_INFO: `/v3/users/695385a0b2e5471ebaab73bf5e5ab429` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:48.578098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] RBAC: Authorizing `identity:delete_user(user_id=695385a0b2e5471ebaab73bf5e5ab429)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:48.580018 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:48.991727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695385a0b2e5471ebaab73bf5e5ab429'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:48.992666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695385a0b2e5471ebaab73bf5e5ab429'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:48.993238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695385a0b2e5471ebaab73bf5e5ab429'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:49.004332 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:49.009872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695385a0b2e5471ebaab73bf5e5ab429'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:49.147675 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695385a0b2e5471ebaab73bf5e5ab429'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:49.160634 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1372/2749] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:48 2022] DELETE /identity/v3/users/695385a0b2e5471ebaab73bf5e5ab429 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:49.165265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:49.166087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:49.166087 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:49.184811 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:49.186064 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:49.251852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1378/2750] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:49.269855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:49.269855 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:49.337925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c9f9b-10a5-4e4f-bb8e-bd874f05f50f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:49.341573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:49.342215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:49.342498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:49.342771 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:49.352599 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:49.354102 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:49.365076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1373/2751] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:49.897961 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:49.899518 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:49.915017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05a832-5589-4695-a729-9dab0d0265fd None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:49.920481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:49.921328 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:49.921614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:49.921919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] PATH_INFO: `/v3/projects/a4e7ec5c128647908d9f06e286866dfd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:49.923046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e7ec5c128647908d9f06e286866dfd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:49.924930 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:49.933388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:50.125806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e7ec5c128647908d9f06e286866dfd', 'request_id': 'req-889a7b01-168c-4f7d-b74a-7328aa80e043'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.132497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e7ec5c128647908d9f06e286866dfd', 'request_id': 'req-889a7b01-168c-4f7d-b74a-7328aa80e043'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.319865 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e7ec5c128647908d9f06e286866dfd', 'request_id': 'req-889a7b01-168c-4f7d-b74a-7328aa80e043'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.331373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] The token cache is being invalidate because project a4e7ec5c128647908d9f06e286866dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:50.340448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.340448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.340448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1379/2752] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:49 2022] DELETE /identity/v3/projects/a4e7ec5c128647908d9f06e286866dfd => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:50.342330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:50.352166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19707caf-0d92-4f5b-88cf-f35f4233d936 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:50.410040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:50.410729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:50.411013 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:50.411289 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] PATH_INFO: `/v3/users/22f54de839c84679b21fe01ef2c3cd4e` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:50.412426 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f54de839c84679b21fe01ef2c3cd4e)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:50.414388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:50.710311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f54de839c84679b21fe01ef2c3cd4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.711024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f54de839c84679b21fe01ef2c3cd4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.711641 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f54de839c84679b21fe01ef2c3cd4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.723662 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f54de839c84679b21fe01ef2c3cd4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.828052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f0b44d47-e527-4632-8295-c62c7e655055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f54de839c84679b21fe01ef2c3cd4e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:50.837811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:50.843041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1374/2753] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:50 2022] DELETE /identity/v3/users/22f54de839c84679b21fe01ef2c3cd4e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:51.326438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:51.327972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:51.343428 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a7b01-168c-4f7d-b74a-7328aa80e043 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:51.405995 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:51.406633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:51.406917 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:51.407192 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] PATH_INFO: `/v3/projects/a8405ccf56f44c0ba04a40474724024b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:51.408356 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8405ccf56f44c0ba04a40474724024b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:51.410358 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:51.548760 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8405ccf56f44c0ba04a40474724024b', 'request_id': 'req-3aee163b-1671-4f6e-b126-f6b0e9156b65'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:51.555265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8405ccf56f44c0ba04a40474724024b', 'request_id': 'req-3aee163b-1671-4f6e-b126-f6b0e9156b65'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:51.627607 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8405ccf56f44c0ba04a40474724024b', 'request_id': 'req-3aee163b-1671-4f6e-b126-f6b0e9156b65'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:51.638985 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] The token cache is being invalidate because project a8405ccf56f44c0ba04a40474724024b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:51.639276 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:51.639919 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3aee163b-1671-4f6e-b126-f6b0e9156b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:51.641434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1380/2754] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:51 2022] DELETE /identity/v3/projects/a8405ccf56f44c0ba04a40474724024b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:51.646904 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:51.647393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:51.647507 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:51.666969 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:51.668190 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:51.726893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1375/2755] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:51.734621 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:51.734959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:51.735241 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:51.756635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:51.757898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:51.765756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1381/2756] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:51.770580 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:51.780682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822e76f-eb42-4aba-bb4b-27ad3637d7ac None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:51.785434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:51.786149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:51.786434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:51.786707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:51.787352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:58:51.787656 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:51.789285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:51.801095 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1376/2757] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:58:51.805362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:51.814950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc246d51-2940-43f9-91c3-29b2f1e0a27f None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:51.820586 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:51.821195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:51.822054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:51.822054 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:51.822389 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:51.824288 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:51.982505 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:51.990171 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1382/2758] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:51 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:51.994430 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.005273 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6632e-f2a2-4d2b-bfb3-c613f9ea3511 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.060894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.061527 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.061867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.062117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.062724 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.064623 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.165152 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1377/2759] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:51 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:52.169277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.180636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3348a2f-eb38-4479-a0e5-0fbb5c080cc6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.185507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.186149 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.186432 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.186734 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.187567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.189231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.200894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1383/2760] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:52.204926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.215161 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e5bd-b554-4ea1-b911-28eebb800ff8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.219877 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dfd481-8daa-4dfd-aa43-e2d5f2737df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.220475 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd481-8daa-4dfd-aa43-e2d5f2737df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.220756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd481-8daa-4dfd-aa43-e2d5f2737df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.221030 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfd481-8daa-4dfd-aa43-e2d5f2737df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.221672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfd481-8daa-4dfd-aa43-e2d5f2737df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.223281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dfd481-8daa-4dfd-aa43-e2d5f2737df5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.233888 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1378/2761] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:52.237970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.248462 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f0577-9d21-4fc7-9af4-a903134f0ee6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.253154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.253823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.254802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.255141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] PATH_INFO: `/v3/projects/e9e5b195205146d7952eea2ac4631a86/users/31e335950c6e42cba52daad5e05bcd39/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.269634 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e5b195205146d7952eea2ac4631a86, user_id=31e335950c6e42cba52daad5e05bcd39, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.272411 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.359630 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1384/2762] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:52 2022] PUT /identity/v3/projects/e9e5b195205146d7952eea2ac4631a86/users/31e335950c6e42cba52daad5e05bcd39/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:52.372196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea19c-693b-425b-b6e4-80056389232f None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.372482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea19c-693b-425b-b6e4-80056389232f None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.372756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ea19c-693b-425b-b6e4-80056389232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.401380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-061ea19c-693b-425b-b6e4-80056389232f None None] MFA Rules not processed for user `31e335950c6e42cba52daad5e05bcd39`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:52.402773 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-061ea19c-693b-425b-b6e4-80056389232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:52.463917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:52.473619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1379/2763] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:52.505998 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.570324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668f027-0269-462f-900a-797ecba9a48a admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.575111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.575739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.576004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.576281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.576909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.578854 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.760726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1385/2764] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:52 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:52.764897 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea19c-693b-425b-b6e4-80056389232f None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.775719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ea19c-693b-425b-b6e4-80056389232f None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.833006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.833624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.833925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.834199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.834840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.836755 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.942389 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1380/2765] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:52 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:52.946503 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.957099 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53090fd5-a4bb-4607-bd32-a9d37a8a8fa1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.962058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.962666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.962949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.963222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:52.963986 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:52.965574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:52.976699 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1386/2766] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:52.981156 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:52.992022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ef072-7212-4cae-9e70-a055f327287a admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:52.996631 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:52.997280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:52.997561 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:52.997890 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] PATH_INFO: `/v3/projects/66bee954e8d247b2abf54acb25a3c250/users/14e0d8c145ed4b1c8ef4a38a1910af91/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:53.013068 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bee954e8d247b2abf54acb25a3c250, user_id=14e0d8c145ed4b1c8ef4a38a1910af91, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:53.015722 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:53.091103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1381/2767] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:52 2022] PUT /identity/v3/projects/66bee954e8d247b2abf54acb25a3c250/users/14e0d8c145ed4b1c8ef4a38a1910af91/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:53.095320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:53.106201 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8044f-60a9-4c8c-bc10-a7b5cfbb161b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:53.164137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd897-b276-4f24-b7f6-9b7262813aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:53.164740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd897-b276-4f24-b7f6-9b7262813aec admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:53.165019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd897-b276-4f24-b7f6-9b7262813aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:53.165293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd897-b276-4f24-b7f6-9b7262813aec admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:53.165970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd897-b276-4f24-b7f6-9b7262813aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:53.167554 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd897-b276-4f24-b7f6-9b7262813aec admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:53.177404 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1387/2768] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:53.181844 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:53.192449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb289eb5-fad6-4137-a795-ebb81296d297 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:53.197199 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:53.197957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:53.198253 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:53.198547 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] PATH_INFO: `/v3/projects/66bee954e8d247b2abf54acb25a3c250/users/14e0d8c145ed4b1c8ef4a38a1910af91/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:53.200493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bee954e8d247b2abf54acb25a3c250, user_id=14e0d8c145ed4b1c8ef4a38a1910af91, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:53.203233 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:53.214227 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1382/2769] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:53 2022] PUT /identity/v3/projects/66bee954e8d247b2abf54acb25a3c250/users/14e0d8c145ed4b1c8ef4a38a1910af91/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:53.225341 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:53.225632 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:53.225942 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:53.253583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] MFA Rules not processed for user `14e0d8c145ed4b1c8ef4a38a1910af91`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:53.255639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:53.275898 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:53.328782 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1388/2770] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:53.340609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:53.342727 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:53.401941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a43aa-8ee0-4856-910f-a892442abcbd admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:53.405778 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ac69-97c6-4091-ad6c-7d2c77464643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:53.406402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ac69-97c6-4091-ad6c-7d2c77464643 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:53.406681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ac69-97c6-4091-ad6c-7d2c77464643 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:53.406954 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ac69-97c6-4091-ad6c-7d2c77464643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:53.416957 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57ac69-97c6-4091-ad6c-7d2c77464643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:53.418451 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57ac69-97c6-4091-ad6c-7d2c77464643 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:53.428016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1383/2771] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:54.876832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:54.939299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb70fe0-12e8-4192-af86-7d860d6fb084 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:54.943771 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:54.944391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:54.944672 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:54.944941 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] PATH_INFO: `/v3/users/31e335950c6e42cba52daad5e05bcd39` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:54.946096 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e335950c6e42cba52daad5e05bcd39)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:54.948004 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:55.109708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e335950c6e42cba52daad5e05bcd39'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:55.110410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e335950c6e42cba52daad5e05bcd39'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:55.111019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e335950c6e42cba52daad5e05bcd39'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:55.123016 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e335950c6e42cba52daad5e05bcd39'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:55.210502 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e335950c6e42cba52daad5e05bcd39'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:55.223302 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1389/2772] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:54 2022] DELETE /identity/v3/users/31e335950c6e42cba52daad5e05bcd39 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:58:55.231438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:55.231438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:55.231438 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:55.248477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:55.249691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:55.301415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:55.315802 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1384/2773] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:55.326714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:55.328204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:55.375843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:55.391731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75416ddf-5ab6-47cd-a891-7f1dc0eaf379 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:55.395724 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:55.396344 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:55.396624 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:55.396896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:55.406645 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:55.408077 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:55.417635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1390/2774] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:55.983829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:55.985323 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:56.002673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a13aeb-99c7-4a8a-8efc-169c515d278e None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:56.005148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:56.005845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:56.006126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:56.006395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] PATH_INFO: `/v3/projects/e9e5b195205146d7952eea2ac4631a86` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:56.007614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e5b195205146d7952eea2ac4631a86)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:56.010073 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:56.200116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e5b195205146d7952eea2ac4631a86', 'request_id': 'req-371e3d5a-343c-4e5a-a425-4ebb7faaabba'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.206462 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e5b195205146d7952eea2ac4631a86', 'request_id': 'req-371e3d5a-343c-4e5a-a425-4ebb7faaabba'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.212456 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e5b195205146d7952eea2ac4631a86', 'request_id': 'req-371e3d5a-343c-4e5a-a425-4ebb7faaabba'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.301479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] The token cache is being invalidate because project e9e5b195205146d7952eea2ac4631a86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:56.302115 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.304929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.304929 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1385/2775] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:55 2022] DELETE /identity/v3/projects/e9e5b195205146d7952eea2ac4631a86 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:56.308154 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:56.318092 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf66b9-9810-4ff1-bcf7-a5db51452184 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:56.376978 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:56.377849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:56.378137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:56.378416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] PATH_INFO: `/v3/users/14e0d8c145ed4b1c8ef4a38a1910af91` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:56.380135 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e0d8c145ed4b1c8ef4a38a1910af91)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:56.382286 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:56.677214 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e0d8c145ed4b1c8ef4a38a1910af91'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.677913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e0d8c145ed4b1c8ef4a38a1910af91'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.678528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e0d8c145ed4b1c8ef4a38a1910af91'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.690284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e0d8c145ed4b1c8ef4a38a1910af91'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.862230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4d0f6d0b-6825-401b-913a-1ff8532d723d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e0d8c145ed4b1c8ef4a38a1910af91'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:56.875378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1391/2776] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:56 2022] DELETE /identity/v3/users/14e0d8c145ed4b1c8ef4a38a1910af91 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:57.322125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:57.323920 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:57.344035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e3d5a-343c-4e5a-a425-4ebb7faaabba admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:57.417756 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:57.418448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:57.418734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:57.419009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] PATH_INFO: `/v3/projects/66bee954e8d247b2abf54acb25a3c250` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:57.420127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66bee954e8d247b2abf54acb25a3c250)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:57.422081 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:57.561282 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66bee954e8d247b2abf54acb25a3c250', 'request_id': 'req-71af553d-67fc-4f94-b73b-86a44d7cf867'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:57.567996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66bee954e8d247b2abf54acb25a3c250', 'request_id': 'req-71af553d-67fc-4f94-b73b-86a44d7cf867'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:57.573882 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66bee954e8d247b2abf54acb25a3c250', 'request_id': 'req-71af553d-67fc-4f94-b73b-86a44d7cf867'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:57.700286 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] The token cache is being invalidate because project 66bee954e8d247b2abf54acb25a3c250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:58:57.700493 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:57.701118 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-71af553d-67fc-4f94-b73b-86a44d7cf867 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:57.702681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1386/2777] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:57 2022] DELETE /identity/v3/projects/66bee954e8d247b2abf54acb25a3c250 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:57.708254 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:57.708756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:57.708870 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:57.729264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:57.730512 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:57.782325 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:57.791292 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1392/2778] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:57.800701 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:57.816598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:57.816598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:57.816598 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:57.820880 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:57.822181 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:57.830169 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1387/2779] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:57.835593 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:57.845304 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edad0f-fa38-45b9-9b22-8bc205e93ab1 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:57.850491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:57.851085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:57.851367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:57.851635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:57.852271 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:58:57.852574 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:57.854193 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:57.866313 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1393/2780] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:58:57.876814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:57.886005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba667c12-758e-4613-b298-54b2217818d1 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:57.890664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:57.891257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:57.891536 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:57.891805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:57.892427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:57.894352 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.075782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1388/2781] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:58:57 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:58:58.080367 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:58.091567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cd211-e181-45f4-aaef-de673615aaa6 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:58.150161 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:58.150795 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.151070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.151339 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.151977 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:58.154189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.245694 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1394/2782] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:58:58 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:58:58.249250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:58.260117 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6f72-82bd-4f18-9220-b03e27150f21 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:58.264818 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:58.265417 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.265700 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.266008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.266651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:58.268239 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.278730 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1389/2783] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:58.282935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:58.293176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa4f66-634f-4d0d-bef3-8e7ae45bb49b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:58.297890 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506c5f4-fd49-4269-b372-73aac7b3a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:58.298491 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c5f4-fd49-4269-b372-73aac7b3a4af admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.298774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c5f4-fd49-4269-b372-73aac7b3a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.299070 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506c5f4-fd49-4269-b372-73aac7b3a4af admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.299707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506c5f4-fd49-4269-b372-73aac7b3a4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:58.301293 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506c5f4-fd49-4269-b372-73aac7b3a4af admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.311786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1395/2784] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:58:58.316810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:58.328736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb0b92-ea63-4a4c-a312-b476452eb2be admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:58.332982 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:58.333681 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.334006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.334281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] PATH_INFO: `/v3/projects/44e2193102394685952b6c8f0b33a273/users/0959806bb73f4b9286e481d7637e825b/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.350868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e2193102394685952b6c8f0b33a273, user_id=0959806bb73f4b9286e481d7637e825b, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:58.353553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.428034 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1390/2785] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:58:58 2022] PUT /identity/v3/projects/44e2193102394685952b6c8f0b33a273/users/0959806bb73f4b9286e481d7637e825b/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:58:58.438644 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.438932 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.439209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.468317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] MFA Rules not processed for user `0959806bb73f4b9286e481d7637e825b`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:58.469585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:58.536832 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1396/2786] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:58.548333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:58.554189 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:58.608529 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18f8e0-a494-449c-b328-2e3381953f6b admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:58.612145 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60765eda-7200-4a31-8cce-ed9b58eb38a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:58.612731 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765eda-7200-4a31-8cce-ed9b58eb38a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.613009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765eda-7200-4a31-8cce-ed9b58eb38a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.613811 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60765eda-7200-4a31-8cce-ed9b58eb38a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.622413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765eda-7200-4a31-8cce-ed9b58eb38a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:58.623871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60765eda-7200-4a31-8cce-ed9b58eb38a5 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.633563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1391/2787] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:58:58.652700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:58.711348 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:58.716792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21cb6-7225-4a39-b1d1-9552c3e69ef4 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:58.721530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:58.730319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:58.730319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:58.730319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] PATH_INFO: `/v3/users/0959806bb73f4b9286e481d7637e825b` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:58.730319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0959806bb73f4b9286e481d7637e825b)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:58.730319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:58.972730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0959806bb73f4b9286e481d7637e825b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:58.973390 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0959806bb73f4b9286e481d7637e825b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:58.974067 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0959806bb73f4b9286e481d7637e825b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:58.986221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0959806bb73f4b9286e481d7637e825b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:59.096020 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0959806bb73f4b9286e481d7637e825b'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:59.108979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1397/2788] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:58:58 2022] DELETE /identity/v3/users/0959806bb73f4b9286e481d7637e825b => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:58:59.113626 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:59.113943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:59.114218 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:59.133577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:58:59.134816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:59.196045 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1392/2789] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:58:59.205476 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:59.206949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:59.269867 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073e6cc-1741-4511-b3c3-e14dab86f923 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:59.274119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4da77c9-837f-4223-bf73-b163586c1783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:59.274722 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da77c9-837f-4223-bf73-b163586c1783 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:59.275000 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da77c9-837f-4223-bf73-b163586c1783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:59.279844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4da77c9-837f-4223-bf73-b163586c1783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:59.284964 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da77c9-837f-4223-bf73-b163586c1783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:59.286460 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4da77c9-837f-4223-bf73-b163586c1783 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:59.296185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1398/2790] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:58:59.840319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:58:59.841860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:58:59.854876 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8e6ea-d81f-4e21-8b7d-59caf8dfb521 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:58:59.859828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:58:59.860468 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:58:59.860784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:58:59.861062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] PATH_INFO: `/v3/projects/44e2193102394685952b6c8f0b33a273` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:58:59.862433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e2193102394685952b6c8f0b33a273)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:58:59.864442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:58:59.969573 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:58:59.976846 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e2193102394685952b6c8f0b33a273', 'request_id': 'req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:59.982903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e2193102394685952b6c8f0b33a273', 'request_id': 'req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:58:59.988359 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e2193102394685952b6c8f0b33a273', 'request_id': 'req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:00.106971 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] The token cache is being invalidate because project 44e2193102394685952b6c8f0b33a273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:00.107198 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:00.107814 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-18f1fde3-ba2b-4d1d-8aee-5b42677843fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:00.109319 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1393/2791] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:58:59 2022] DELETE /identity/v3/projects/44e2193102394685952b6c8f0b33a273 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:00.114393 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.115079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.115079 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.135144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:00.136278 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:00.199204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1399/2792] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:00.207565 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.207859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.208140 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.228842 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:00.230097 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:00.238330 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1394/2793] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:00.242484 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:00.252273 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a475c18-5a97-48f8-970d-92998f135470 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:00.256912 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:00.257509 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.257818 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.258094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.258736 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:00.259040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:00.260620 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:00.272483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1400/2794] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:00.277605 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:00.287269 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b439a-bc31-4f6c-a667-a344566e9f3c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:00.292822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:00.293428 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.293708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.297407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.297407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:00.297407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:00.388826 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1395/2795] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:00 2022] POST /identity/v3/projects => generated 359 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:00.393100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:00.400234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:00.404224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdec08-72dd-4d48-8be2-889f63765407 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:00.463980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:00.464597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.464894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.465169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.465813 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:00.467735 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:00.720085 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1401/2796] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:00 2022] POST /identity/v3/users => generated 280 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:00.722500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:00.732861 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499983a-a289-49d8-b219-f3ef87f48207 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:00.737708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:00.738357 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.738640 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.738918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.739568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:00.741158 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:00.752000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1396/2797] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:00.755831 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:00.766612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a63329-4aa3-4f14-aec1-d9e3069790e4 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:00.772397 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dbb35-e090-4bab-8dbe-306f5c8ae35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:00.773654 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dbb35-e090-4bab-8dbe-306f5c8ae35c admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.774008 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dbb35-e090-4bab-8dbe-306f5c8ae35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.774295 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dbb35-e090-4bab-8dbe-306f5c8ae35c admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.774869 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dbb35-e090-4bab-8dbe-306f5c8ae35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:00.776447 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dbb35-e090-4bab-8dbe-306f5c8ae35c admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:00.788047 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1402/2798] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:00.793392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:00.803776 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53418c-7dff-4631-899a-c8158a5fffac admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:00.808879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:00.809528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.809852 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.810135 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] PATH_INFO: `/v3/projects/2552f98fa9224b0992e4b48ca5615bc4/users/faf330cb72b545348b5d2397e04750aa/roles/9386846542804a8b96776ed9753a7628` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.834609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2552f98fa9224b0992e4b48ca5615bc4, user_id=faf330cb72b545348b5d2397e04750aa, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:00.834609 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:00.942010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1397/2799] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:00 2022] PUT /identity/v3/projects/2552f98fa9224b0992e4b48ca5615bc4/users/faf330cb72b545348b5d2397e04750aa/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:00.960247 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:00.960598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:00.960806 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:00.989576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] MFA Rules not processed for user `faf330cb72b545348b5d2397e04750aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:00.990823 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:01.056378 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1403/2800] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:01.094834 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:01.096638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:01.154996 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a227541-97d8-43a1-ba19-c0f32148d066 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:01.158715 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe16bc3-0738-4584-b20f-c987bf995e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:01.159315 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16bc3-0738-4584-b20f-c987bf995e71 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:01.162708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16bc3-0738-4584-b20f-c987bf995e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:01.162708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe16bc3-0738-4584-b20f-c987bf995e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:01.168371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe16bc3-0738-4584-b20f-c987bf995e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:01.169809 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe16bc3-0738-4584-b20f-c987bf995e71 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:01.178583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1398/2801] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:01.197189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:01.264386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936bda1b-6b7e-4e31-b580-fc6de20621f4 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:01.269696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:01.270363 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:01.270641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:01.270913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] PATH_INFO: `/v3/users/faf330cb72b545348b5d2397e04750aa` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:01.272162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf330cb72b545348b5d2397e04750aa)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:01.279342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:01.289810 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:01.458537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf330cb72b545348b5d2397e04750aa'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:01.459106 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf330cb72b545348b5d2397e04750aa'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:01.459709 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf330cb72b545348b5d2397e04750aa'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:01.472426 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf330cb72b545348b5d2397e04750aa'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:01.592936 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf330cb72b545348b5d2397e04750aa'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:01.606157 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1404/2802] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:01 2022] DELETE /identity/v3/users/faf330cb72b545348b5d2397e04750aa => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:01.610925 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:01.611219 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:01.611501 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:01.631114 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:01.632378 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:01.690916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1399/2803] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:01.700716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:01.702178 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:01.759702 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9518214-80d7-4693-852a-c3aeb4acc399 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:01.763226 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:01.763822 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:01.764097 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:01.764365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:01.773844 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:01.775255 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:01.784877 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1405/2804] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:02.275822 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:02.277304 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:02.291559 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf4f32-e82b-42a7-983c-0557ecda38f2 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:02.296718 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:02.297563 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:02.297941 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:02.298291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] PATH_INFO: `/v3/projects/2552f98fa9224b0992e4b48ca5615bc4` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:02.299705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2552f98fa9224b0992e4b48ca5615bc4)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:02.301805 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:02.304003 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:02.451238 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2552f98fa9224b0992e4b48ca5615bc4', 'request_id': 'req-086b3e86-4812-41e7-b215-e793cb25c082'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:02.465857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2552f98fa9224b0992e4b48ca5615bc4', 'request_id': 'req-086b3e86-4812-41e7-b215-e793cb25c082'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:02.478572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2552f98fa9224b0992e4b48ca5615bc4', 'request_id': 'req-086b3e86-4812-41e7-b215-e793cb25c082'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:02.632072 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] The token cache is being invalidate because project 2552f98fa9224b0992e4b48ca5615bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:02.632410 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:02.633556 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:02.635090 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1400/2805] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:02 2022] DELETE /identity/v3/projects/2552f98fa9224b0992e4b48ca5615bc4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:03.949403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:03.951094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:04.044967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7f5eb-1243-4e86-8467-7a62032ae759 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:04.092321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:04.145706 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:04.146723 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:04.147164 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:04.147595 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:04.149737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:04.165979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:04.169291 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679db045-bb15-40b5-b1f9-ac191a25949f service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:04.182575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1406/2806] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:04.646740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:04.648723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:04.769355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b3e86-4812-41e7-b215-e793cb25c082 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:04.769355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:04.769355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:04.769355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:04.769732 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] PATH_INFO: `/v3/users/50229be4f4084a2e9a4fc55d0c2480a0` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:04.770602 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50229be4f4084a2e9a4fc55d0c2480a0)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:04.772611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:05.071587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50229be4f4084a2e9a4fc55d0c2480a0'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:05.072248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50229be4f4084a2e9a4fc55d0c2480a0'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:05.072853 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50229be4f4084a2e9a4fc55d0c2480a0'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:05.084782 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50229be4f4084a2e9a4fc55d0c2480a0'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:05.159008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50229be4f4084a2e9a4fc55d0c2480a0'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:05.178523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1401/2807] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:04 2022] DELETE /identity/v3/users/50229be4f4084a2e9a4fc55d0c2480a0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:05.183007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:05.183525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:05.183525 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:05.205737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:05.206982 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:05.271716 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1407/2808] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:59:05.282248 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:05.283723 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:05.294984 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:05.341794 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135014d-8cfa-4dcd-a85c-697cf1441f09 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:05.345423 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3b895-acc8-42d6-8a0e-3bffa4135398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:05.346318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3b895-acc8-42d6-8a0e-3bffa4135398 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:05.346615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3b895-acc8-42d6-8a0e-3bffa4135398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:05.347112 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3b895-acc8-42d6-8a0e-3bffa4135398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:05.357133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3b895-acc8-42d6-8a0e-3bffa4135398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:05.358741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3b895-acc8-42d6-8a0e-3bffa4135398 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:05.368442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1402/2809] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:05.917280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:05.918731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:05.931388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a63c1f-1b9a-4312-a050-a284f7097e85 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:05.936185 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:05.936852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:05.937158 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:05.937467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] PATH_INFO: `/v3/projects/352afa78d46040e89b12b5e47730b80d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:05.938578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=352afa78d46040e89b12b5e47730b80d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:05.940575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.058342 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352afa78d46040e89b12b5e47730b80d', 'request_id': 'req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:06.066246 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352afa78d46040e89b12b5e47730b80d', 'request_id': 'req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:06.152585 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352afa78d46040e89b12b5e47730b80d', 'request_id': 'req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:06.164461 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] The token cache is being invalidate because project 352afa78d46040e89b12b5e47730b80d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:06.164747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:06.165388 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-c3c500fd-fd3a-4358-8755-aa9b85f1a42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:06.166916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1408/2810] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:05 2022] DELETE /identity/v3/projects/352afa78d46040e89b12b5e47730b80d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:06.172079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.172625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.172625 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.193408 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:06.194669 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:06.256231 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1403/2811] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:06.264730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.264730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.264730 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.289999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:06.291246 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:06.299520 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1409/2812] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:59:06.303835 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:06.315344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946addc1-a582-4dfe-9c06-cf081b0d5889 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:06.319952 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:06.320550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.320829 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.321220 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.321906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:06.322207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:06.323867 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.336777 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1404/2813] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:06.341508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:06.351530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad4578-5f6e-4086-a043-da9a3004b422 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:06.356511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:06.357213 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.357562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.357935 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.358655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:06.360604 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.464120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1410/2814] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:06 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:06.469372 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:06.480921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ed795-cb90-409c-864d-dd094ee7803f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:06.542393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:06.543038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.543316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.543610 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.544240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:06.546187 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.667706 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1405/2815] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:06 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:59:06.671905 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:06.682843 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5951d789-19f8-4de5-9c60-c15ba023ccd3 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:06.687395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:06.688120 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.688399 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.688670 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.689309 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:06.690923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.702279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1411/2816] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:06.706461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:06.717543 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c1a6c-b10e-415d-8a75-e0a6faae46c7 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:06.722494 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fff19c-aaec-4821-a550-e2e5e85e1149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:06.723124 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff19c-aaec-4821-a550-e2e5e85e1149 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.723386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff19c-aaec-4821-a550-e2e5e85e1149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.723657 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fff19c-aaec-4821-a550-e2e5e85e1149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.724300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fff19c-aaec-4821-a550-e2e5e85e1149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:06.725943 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fff19c-aaec-4821-a550-e2e5e85e1149 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.739221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1406/2817] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:06.743440 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:06.748895 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:06.754522 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773a89f-c026-4383-917b-b4cc0a889696 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:06.759817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:06.760480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.760792 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.761072 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] PATH_INFO: `/v3/projects/5b279c970d744d7791300422d2bb96df/users/ab7985b06ead4389a37d0f2c9b77eaf5/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.776944 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b279c970d744d7791300422d2bb96df, user_id=ab7985b06ead4389a37d0f2c9b77eaf5, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:06.779937 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:06.913041 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1412/2818] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:06 2022] PUT /identity/v3/projects/5b279c970d744d7791300422d2bb96df/users/ab7985b06ead4389a37d0f2c9b77eaf5/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:06.923407 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:06.923628 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:06.923901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:06.952032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] MFA Rules not processed for user `ab7985b06ead4389a37d0f2c9b77eaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:06.953209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:06.958234 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:07.015366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1407/2819] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:07.026561 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:07.029115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:07.087696 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fdf6f-5e5d-41f0-8479-2ec80d2c6272 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:07.091609 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845fe08-9f19-46a8-9f10-064cba88778d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:07.092221 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845fe08-9f19-46a8-9f10-064cba88778d service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:07.092504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845fe08-9f19-46a8-9f10-064cba88778d service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:07.092781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845fe08-9f19-46a8-9f10-064cba88778d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:07.103906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845fe08-9f19-46a8-9f10-064cba88778d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:07.104618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845fe08-9f19-46a8-9f10-064cba88778d service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:07.115272 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1413/2820] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:09.668790 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:09.670285 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:09.728364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19839d-d883-49a1-a7eb-1a704339d919 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:09.732009 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:09.732618 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:09.732903 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:09.733179 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:09.734949 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:09.798006 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:09.799803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:09.810058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1408/2821] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:10.092459 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:10.093011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:10.093011 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:10.113997 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] MFA Rules not processed for user `ab7985b06ead4389a37d0f2c9b77eaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:10.115240 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:10.127144 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1414/2822] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:14.370349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:14.371833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:14.384921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3f8e8-a4bd-4f4c-82f9-faa42d1b503b service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:14.389703 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:14.390612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:14.390901 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:14.391176 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] PATH_INFO: `/v3/users/790de0d0a3954663b4f2f140517b5ca5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:14.407365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] RBAC: Authorizing `identity:delete_user(user_id=790de0d0a3954663b4f2f140517b5ca5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:14.409267 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:14.636478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:14.641467 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790de0d0a3954663b4f2f140517b5ca5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:14.642141 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790de0d0a3954663b4f2f140517b5ca5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:14.642784 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790de0d0a3954663b4f2f140517b5ca5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:14.655263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790de0d0a3954663b4f2f140517b5ca5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:14.763725 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ebc99db1-c6e3-450b-92c7-e05e5590f47d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790de0d0a3954663b4f2f140517b5ca5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:14.776910 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1409/2823] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:14 2022] DELETE /identity/v3/users/790de0d0a3954663b4f2f140517b5ca5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:15.074742 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:15.087434 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26ff3-2ba7-4a93-a620-5faf5cb80136 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:15.149055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:15.149726 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.150130 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.150400 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] PATH_INFO: `/v3/projects/c73e6993420b4bbe9280d32ebdfc0505` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.161618 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73e6993420b4bbe9280d32ebdfc0505)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:15.164132 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:15.306909 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73e6993420b4bbe9280d32ebdfc0505', 'request_id': 'req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:15.315046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73e6993420b4bbe9280d32ebdfc0505', 'request_id': 'req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:15.501040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73e6993420b4bbe9280d32ebdfc0505', 'request_id': 'req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:15.506893 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:15.520530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] The token cache is being invalidate because project c73e6993420b4bbe9280d32ebdfc0505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:15.520530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:15.520530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-3e02a970-4fa6-4b9d-ae7d-18cf51b96a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:15.520530 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1415/2824] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:15 2022] DELETE /identity/v3/projects/c73e6993420b4bbe9280d32ebdfc0505 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:15.521336 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.521801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.522048 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.549664 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:15.554862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:15.625311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1410/2825] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:15.633319 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.633906 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.634264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.658118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:15.660482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:15.673113 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1416/2826] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:59:15.690621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:15.701655 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1964ba3-7a84-4a13-83b1-f1ebfb674e37 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:15.707570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:15.708204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.708492 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.709272 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.709437 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:15.710412 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:15.712347 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:15.733719 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1411/2827] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:15.734845 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:15.745035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d951b1-713b-4db4-a879-5b80ff174724 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:15.750215 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:15.750834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.751115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.751391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.752167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:15.754143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:15.874030 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1417/2828] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:15 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:59:15.878353 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:15.888666 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412174d-a440-4c9b-a1af-419b37cec66d admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:15.946119 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:15.946740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:15.947024 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:15.947300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:15.947933 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:15.949886 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:16.037206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1412/2829] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:15 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 03:59:16.038514 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:16.048984 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d261b97-f758-43ca-bfb7-3e8667e14131 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:16.054073 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:16.059038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:16.059038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:16.059038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:16.059038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:16.059038 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:16.069089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1418/2830] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:16.074062 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:16.087300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99287f-e736-4ea1-a8e8-ae60d6947db8 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:16.092865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe137fa5-f305-45a9-915d-e3220f485a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:16.093488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137fa5-f305-45a9-915d-e3220f485a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:16.093792 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137fa5-f305-45a9-915d-e3220f485a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:16.094087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe137fa5-f305-45a9-915d-e3220f485a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:16.094741 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe137fa5-f305-45a9-915d-e3220f485a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:16.096402 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe137fa5-f305-45a9-915d-e3220f485a84 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:16.107585 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1413/2831] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:16.112049 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:16.123256 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8db16-607d-48d3-8240-58150dad2c3b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:16.128205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:16.128871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:16.129150 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:16.129425 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] PATH_INFO: `/v3/projects/c6f821e9e0ca4f8f846ccb6afce7e926/users/251699e29e7f477e8c38fe33bd41b0c2/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:16.145206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f821e9e0ca4f8f846ccb6afce7e926, user_id=251699e29e7f477e8c38fe33bd41b0c2, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:16.150862 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:16.275746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1419/2832] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:16 2022] PUT /identity/v3/projects/c6f821e9e0ca4f8f846ccb6afce7e926/users/251699e29e7f477e8c38fe33bd41b0c2/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:16.283916 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:16.284204 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:16.284476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:16.313461 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] MFA Rules not processed for user `251699e29e7f477e8c38fe33bd41b0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:16.314733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:16.328433 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:16.382678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1414/2833] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:16.393633 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:16.395879 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:16.473143 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3336e89-1c60-4676-8b01-e59da7c4a989 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:16.480220 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875dce1b-4b1e-4689-9ce0-80189566e0c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:16.480938 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dce1b-4b1e-4689-9ce0-80189566e0c5 service nova] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:16.481222 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dce1b-4b1e-4689-9ce0-80189566e0c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:16.481497 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875dce1b-4b1e-4689-9ce0-80189566e0c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:16.490187 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dce1b-4b1e-4689-9ce0-80189566e0c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:16.492283 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875dce1b-4b1e-4689-9ce0-80189566e0c5 service nova] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:16.501468 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1420/2834] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:16.720865 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:16.790531 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a15df6-8a7b-4511-9b46-f7a38bfa2c6b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:16.798361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:16.799012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:16.799302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:16.799578 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] PATH_INFO: `/v3/users/251699e29e7f477e8c38fe33bd41b0c2` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:16.800787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251699e29e7f477e8c38fe33bd41b0c2)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:16.802762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:17.017552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251699e29e7f477e8c38fe33bd41b0c2'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:17.018254 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251699e29e7f477e8c38fe33bd41b0c2'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:17.018871 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251699e29e7f477e8c38fe33bd41b0c2'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:17.036750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251699e29e7f477e8c38fe33bd41b0c2'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:17.095076 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251699e29e7f477e8c38fe33bd41b0c2'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:17.108265 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1415/2835] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:16 2022] DELETE /identity/v3/users/251699e29e7f477e8c38fe33bd41b0c2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:17.113014 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:17.113492 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:17.113666 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:17.133615 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:17.134864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:17.200109 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1421/2836] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:17.210442 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:17.211993 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:17.247975 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:17.269798 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c87ed-eb38-446e-a59e-db1741407c63 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:17.273989 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a225a072-867f-41f1-8b83-073117c5ee8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:17.274595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225a072-867f-41f1-8b83-073117c5ee8a service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:17.274879 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225a072-867f-41f1-8b83-073117c5ee8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:17.275166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a225a072-867f-41f1-8b83-073117c5ee8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:17.284642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225a072-867f-41f1-8b83-073117c5ee8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:17.286128 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a225a072-867f-41f1-8b83-073117c5ee8a service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:17.299348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1416/2837] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:17.943373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:17.945268 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:17.961827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32af249-b020-47c1-8d37-97935b1958ea None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:17.967746 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:17.968774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:17.969017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:17.969300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] PATH_INFO: `/v3/projects/c6f821e9e0ca4f8f846ccb6afce7e926` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:17.970570 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f821e9e0ca4f8f846ccb6afce7e926)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:17.972532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:17.985170 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:18.075080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f821e9e0ca4f8f846ccb6afce7e926', 'request_id': 'req-7b47c64d-5c84-4f61-af62-42fe727ddcb5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:18.081910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f821e9e0ca4f8f846ccb6afce7e926', 'request_id': 'req-7b47c64d-5c84-4f61-af62-42fe727ddcb5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:18.146326 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f821e9e0ca4f8f846ccb6afce7e926', 'request_id': 'req-7b47c64d-5c84-4f61-af62-42fe727ddcb5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:18.157441 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] The token cache is being invalidate because project c6f821e9e0ca4f8f846ccb6afce7e926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:18.157725 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:18.158376 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-7b47c64d-5c84-4f61-af62-42fe727ddcb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:18.159842 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1422/2838] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:17 2022] DELETE /identity/v3/projects/c6f821e9e0ca4f8f846ccb6afce7e926 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:18.165371 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.172464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.172464 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.185820 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:18.187044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:18.247058 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1417/2839] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:18.254872 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.255181 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.255456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.275147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:18.276294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:18.284429 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1423/2840] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:18.289126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.299079 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3f768-4d43-4934-b67f-86f1ad59062c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.307726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.308349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.308660 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.308940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.309604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:18.309940 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.311552 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.324638 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1418/2841] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:18.328954 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.338581 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c206f7-6e4b-4a15-965c-3bcbcd193607 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.343403 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.344001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.344285 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.344562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.345180 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.347115 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.417756 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1424/2842] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:18 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:18.422038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.432692 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c7fb6-a8bc-42a2-afbf-618e8b087d73 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.489116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.490787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.490787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.490787 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.491611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.493425 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.599482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1419/2843] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:18 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:18.602387 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.613147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f39d-e08b-4535-b537-82b28a1eba38 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.617803 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.618410 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.618693 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.619091 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.619737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.621327 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.631398 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1425/2844] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:18.635572 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.646142 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ea8bd-caf2-4c1c-b013-3c72b776a0e1 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.651866 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a64be-e185-430c-9410-e66cf40b5974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.652518 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a64be-e185-430c-9410-e66cf40b5974 admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.652798 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a64be-e185-430c-9410-e66cf40b5974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.653387 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a64be-e185-430c-9410-e66cf40b5974 admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.654066 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a64be-e185-430c-9410-e66cf40b5974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.655695 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a64be-e185-430c-9410-e66cf40b5974 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.671726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1420/2845] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:18.677508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:18.689983 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154a40-4a2d-40f1-8c58-52c4414f7af2 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:18.694814 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:18.695493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.696052 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.696224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] PATH_INFO: `/v3/projects/bd0662cb0bac4518872eae13dbfba013/users/c192d5e4fe6b4bda89d9ee56ed65d0cb/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.714871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0662cb0bac4518872eae13dbfba013, user_id=c192d5e4fe6b4bda89d9ee56ed65d0cb, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:18.717639 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:18.832659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1426/2846] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:18 2022] PUT /identity/v3/projects/bd0662cb0bac4518872eae13dbfba013/users/c192d5e4fe6b4bda89d9ee56ed65d0cb/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:18.844663 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:18.844947 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:18.845221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:18.873042 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] MFA Rules not processed for user `c192d5e4fe6b4bda89d9ee56ed65d0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:18.874221 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:18.904808 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:18.939749 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1421/2847] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:18.947590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.011001 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5708c9-1a79-4b8b-8d78-066836ae6d3d admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.016300 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.016934 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.017209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.017483 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.018162 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.020244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.159883 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1427/2848] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:18 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:19.164500 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.175454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd8d44-8685-4c72-ad11-ffdef3880a99 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.241489 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.242162 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.242471 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.242743 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.243385 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.245314 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.352177 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1422/2849] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:19 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:19.356340 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.368301 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d256-914b-4f55-ae05-b577045b66e4 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.373094 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.373755 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.379006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.379006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.379006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.379006 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.388781 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1428/2850] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:19.393107 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.404196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16544e-07dd-48bb-9cad-2f6a133b6dc4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.409708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.409708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.409708 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.410087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] PATH_INFO: `/v3/projects/7f460aa5ecf84692920992984c5b2726/users/5a1a222cc6e74da5b331357e72a72b34/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.425488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f460aa5ecf84692920992984c5b2726, user_id=5a1a222cc6e74da5b331357e72a72b34, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.428202 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.530138 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1423/2851] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:19 2022] PUT /identity/v3/projects/7f460aa5ecf84692920992984c5b2726/users/5a1a222cc6e74da5b331357e72a72b34/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:19.534234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.544957 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79564144-d6f7-4f0a-802d-f9a2227978d1 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.552733 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:19.606421 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aabfb-b1ae-40ed-9632-5bb83b45cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.607033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aabfb-b1ae-40ed-9632-5bb83b45cc57 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.607310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aabfb-b1ae-40ed-9632-5bb83b45cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.607578 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aabfb-b1ae-40ed-9632-5bb83b45cc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.608211 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aabfb-b1ae-40ed-9632-5bb83b45cc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.609816 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aabfb-b1ae-40ed-9632-5bb83b45cc57 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.620238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1429/2852] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:19.624733 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.635012 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58ec95-f9e1-48d1-bd65-24a064f77ae4 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.639647 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.640290 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.640612 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.640854 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] PATH_INFO: `/v3/projects/7f460aa5ecf84692920992984c5b2726/users/5a1a222cc6e74da5b331357e72a72b34/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.642856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f460aa5ecf84692920992984c5b2726, user_id=5a1a222cc6e74da5b331357e72a72b34, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.645482 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.656595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1424/2853] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:19 2022] PUT /identity/v3/projects/7f460aa5ecf84692920992984c5b2726/users/5a1a222cc6e74da5b331357e72a72b34/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:19.669721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.669980 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.670262 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.699264 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] MFA Rules not processed for user `5a1a222cc6e74da5b331357e72a72b34`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:19.700488 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:19.771250 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1430/2854] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:19.782661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.784358 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:19.840961 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24c9a-e8ef-4185-950e-a4e09024d6ea admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.844604 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.845200 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.845476 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.845745 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:19.854551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:19.855967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:19.865216 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1425/2855] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:19.965655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:19.975453 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea948-dbff-4605-9be5-b46a4479347c None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:19.979277 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36f620-9e89-4829-9ca1-0425e0e542e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:19.979910 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36f620-9e89-4829-9ca1-0425e0e542e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:19.980191 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36f620-9e89-4829-9ca1-0425e0e542e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:19.980466 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36f620-9e89-4829-9ca1-0425e0e542e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:20.038543 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36f620-9e89-4829-9ca1-0425e0e542e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:20.040235 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36f620-9e89-4829-9ca1-0425e0e542e8 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:20.049571 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1431/2856] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:23.281466 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:23.311232 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:23.345132 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9b26-33c3-48c0-935b-1ba357ff4f55 service cinder] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:23.350004 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:23.350693 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:23.351333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:23.351333 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] PATH_INFO: `/v3/users/c192d5e4fe6b4bda89d9ee56ed65d0cb` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:23.352515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c192d5e4fe6b4bda89d9ee56ed65d0cb)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:23.354463 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:23.526558 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c192d5e4fe6b4bda89d9ee56ed65d0cb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:23.527140 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c192d5e4fe6b4bda89d9ee56ed65d0cb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:23.528016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c192d5e4fe6b4bda89d9ee56ed65d0cb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:23.540577 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c192d5e4fe6b4bda89d9ee56ed65d0cb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:23.615133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c192d5e4fe6b4bda89d9ee56ed65d0cb'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:23.629274 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1426/2857] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:23 2022] DELETE /identity/v3/users/c192d5e4fe6b4bda89d9ee56ed65d0cb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:23.634050 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:23.634641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:23.634764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:23.655056 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:23.656279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:23.682783 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:23.715507 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1432/2858] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:23.725366 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:23.727469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:23.787178 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc62e-4708-443b-9fe1-49af644b30c3 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:23.791038 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:23.791642 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:23.791922 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:23.792223 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:23.801633 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:23.803153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:23.814148 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1427/2859] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:24.377700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:24.377700 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:24.389551 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1eedf-062f-42ad-9b88-6d2756d36300 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:24.394715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:24.395379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:24.395659 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:24.395953 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] PATH_INFO: `/v3/projects/bd0662cb0bac4518872eae13dbfba013` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:24.397196 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0662cb0bac4518872eae13dbfba013)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:24.399270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:24.443449 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:24.445478 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:24.497116 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:24.520360 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2de0e4-8301-4dcb-9f4e-8918d3bf1f02 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:24.526325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:24.526930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:24.527208 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:24.527481 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:24.529479 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:24.542195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:24.543801 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:24.554774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1428/2860] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 03:59:24.650546 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0662cb0bac4518872eae13dbfba013', 'request_id': 'req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:24.657311 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0662cb0bac4518872eae13dbfba013', 'request_id': 'req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:24.780456 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0662cb0bac4518872eae13dbfba013', 'request_id': 'req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:24.792284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] The token cache is being invalidate because project bd0662cb0bac4518872eae13dbfba013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:24.792575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:24.793218 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:24.794745 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1433/2861] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:24 2022] DELETE /identity/v3/projects/bd0662cb0bac4518872eae13dbfba013 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:24.799010 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:24.809930 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cefb66-4691-457e-b4f1-64ea683e5088 service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:24.871667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:24.872240 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:24.872553 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:24.872828 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] PATH_INFO: `/v3/users/5a1a222cc6e74da5b331357e72a72b34` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:24.873985 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1a222cc6e74da5b331357e72a72b34)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:24.875906 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:25.131019 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1a222cc6e74da5b331357e72a72b34'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.132495 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1a222cc6e74da5b331357e72a72b34'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.133302 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1a222cc6e74da5b331357e72a72b34'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.149280 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1a222cc6e74da5b331357e72a72b34'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.243705 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-50e3b98a-a2c7-43f5-b14c-92ede9d4acc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1a222cc6e74da5b331357e72a72b34'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.259950 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1429/2862] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:24 2022] DELETE /identity/v3/users/5a1a222cc6e74da5b331357e72a72b34 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:25.702445 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:25.703916 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:25.720199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a46e04-62fc-4d9a-b08a-57f2326f0e83 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:25.775362 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:25.776034 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:25.776317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:25.776597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] PATH_INFO: `/v3/projects/7f460aa5ecf84692920992984c5b2726` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:25.778002 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f460aa5ecf84692920992984c5b2726)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:25.779979 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:25.895169 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f460aa5ecf84692920992984c5b2726', 'request_id': 'req-9f962e81-7281-4a0e-ab74-9646552a8b20'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.901352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f460aa5ecf84692920992984c5b2726', 'request_id': 'req-9f962e81-7281-4a0e-ab74-9646552a8b20'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.904207 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:25.986141 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f460aa5ecf84692920992984c5b2726', 'request_id': 'req-9f962e81-7281-4a0e-ab74-9646552a8b20'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:25.998040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] The token cache is being invalidate because project 7f460aa5ecf84692920992984c5b2726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:26.003715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:26.003715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-9f962e81-7281-4a0e-ab74-9646552a8b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:26.003715 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1434/2863] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:25 2022] DELETE /identity/v3/projects/7f460aa5ecf84692920992984c5b2726 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:26.006542 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.007050 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.007154 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.027035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:26.038810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:26.076742 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:26.089596 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1430/2864] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:26.097417 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.097705 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.098019 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.118133 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:26.119364 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:26.127454 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1435/2865] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:26.135530 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.145270 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe853d10-60e4-45e2-856d-1571611b7b19 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.150614 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:26.151365 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.151491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.151810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] PATH_INFO: `/v3/domains` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.152415 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81789) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:26.153026 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:26.154624 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:26.167016 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1431/2866] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:26.171321 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.180807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b117be-5929-45cc-b333-6b2e571ed333 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.185598 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:26.186225 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.186504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.186775 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.187430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:26.189318 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:26.328055 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1436/2867] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:26 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:26.331528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.340707 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6cf748-2fee-46df-86a3-70b300a2200b admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.402160 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:26.403296 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.403621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.404067 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.405071 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:26.407092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:26.603958 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1432/2868] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:26 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:26.607950 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.618243 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ae6ca-ace5-4001-a89b-171a770711bd admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.622871 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:26.623479 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.623759 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.624035 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.624675 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:26.626317 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:26.637731 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1437/2869] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:26.641673 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.652185 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b33ec-74a5-42c4-a0ca-81462e4c2bf2 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.657380 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9811b5-2ded-41e7-9cdb-33d3c4d67eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:26.658022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9811b5-2ded-41e7-9cdb-33d3c4d67eea admin admin] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.658334 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9811b5-2ded-41e7-9cdb-33d3c4d67eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.658611 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9811b5-2ded-41e7-9cdb-33d3c4d67eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.659311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9811b5-2ded-41e7-9cdb-33d3c4d67eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:26.660913 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9811b5-2ded-41e7-9cdb-33d3c4d67eea admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:26.671832 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1433/2870] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:26.678118 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.688974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e766a5-1555-44a6-807b-aefff0ab8998 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.693658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:26.694802 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.695076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.695351 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] PATH_INFO: `/v3/projects/fe315edc863442a79fadd9d45843dc46/users/26b64963a2bc4b579ab05af95690271c/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.710904 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe315edc863442a79fadd9d45843dc46, user_id=26b64963a2bc4b579ab05af95690271c, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:26.713583 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:26.821216 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1438/2871] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:26 2022] PUT /identity/v3/projects/fe315edc863442a79fadd9d45843dc46/users/26b64963a2bc4b579ab05af95690271c/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:26.832783 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:26.833070 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:26.833348 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:26.861226 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] MFA Rules not processed for user `26b64963a2bc4b579ab05af95690271c`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:26.862393 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:26.926574 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1434/2872] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:26.931749 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:26.994855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ec28b-c3da-4b8a-a490-74f240d0c494 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:26.999685 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.000294 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.000576 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.000849 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.001508 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.003455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.137373 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1439/2873] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:26 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:27.141587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:27.153080 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ecc1-0e3d-48f3-b99d-86999db1b860 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:27.199418 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:27.211300 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.211921 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.212206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.212484 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.213126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.215088 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.335008 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1435/2874] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:27 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:27.339186 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:27.351163 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e5b66-092d-4d75-8b1a-2e07d51f65b9 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:27.355861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.356471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.356747 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.357017 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.357662 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.359284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.371244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1440/2875] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:27.375567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:27.385894 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6946c-5fb4-4efc-8fc3-e340ecd3c0c9 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:27.391098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.391697 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.392301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.392301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] PATH_INFO: `/v3/projects/114366f0292e499d91c337aa63ba2a72/users/c5f7a4eabe4c4556bc2162d5d17a058d/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.407977 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=114366f0292e499d91c337aa63ba2a72, user_id=c5f7a4eabe4c4556bc2162d5d17a058d, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.410667 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.530345 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1436/2876] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:27 2022] PUT /identity/v3/projects/114366f0292e499d91c337aa63ba2a72/users/c5f7a4eabe4c4556bc2162d5d17a058d/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:27.535219 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:27.546058 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9913f-f3b3-46d7-b8c6-a936bd26628b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:27.599528 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:27.608290 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69d75-ea18-454d-8618-a24354fe9967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.608933 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69d75-ea18-454d-8618-a24354fe9967 admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.609279 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69d75-ea18-454d-8618-a24354fe9967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.609517 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69d75-ea18-454d-8618-a24354fe9967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.610208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f69d75-ea18-454d-8618-a24354fe9967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.611975 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f69d75-ea18-454d-8618-a24354fe9967 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.625708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1441/2877] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 03:59:27.630126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:27.642020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acefff-5cb9-4216-b1e3-3064c7812b68 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:27.646806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.648044 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.648386 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.648661 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] PATH_INFO: `/v3/projects/114366f0292e499d91c337aa63ba2a72/users/c5f7a4eabe4c4556bc2162d5d17a058d/roles/bde35209edd64a3187d196af53f70e5d` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.650627 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=114366f0292e499d91c337aa63ba2a72, user_id=c5f7a4eabe4c4556bc2162d5d17a058d, role_id=bde35209edd64a3187d196af53f70e5d)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.653567 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.665603 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1437/2878] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:27 2022] PUT /identity/v3/projects/114366f0292e499d91c337aa63ba2a72/users/c5f7a4eabe4c4556bc2162d5d17a058d/roles/bde35209edd64a3187d196af53f70e5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:27.686976 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.687266 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.687544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.715801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] MFA Rules not processed for user `c5f7a4eabe4c4556bc2162d5d17a058d`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:27.717100 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:27.787721 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1442/2879] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:59:27.799284 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:27.801195 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:27.863528 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62a673-ae34-4ac7-8ae6-4830e67ef5fe admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:27.867311 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b7214-88f8-4f2b-8c06-a7939a8f235b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:27.867918 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7214-88f8-4f2b-8c06-a7939a8f235b service cinder] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:27.868206 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7214-88f8-4f2b-8c06-a7939a8f235b service cinder] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:27.868474 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b7214-88f8-4f2b-8c06-a7939a8f235b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:27.930409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7214-88f8-4f2b-8c06-a7939a8f235b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:27.931837 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b7214-88f8-4f2b-8c06-a7939a8f235b service cinder] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:27.940821 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1438/2880] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:32.243827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:32.304407 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790fe1-c8f6-41e3-b769-6b98725a19a3 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:32.308967 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:32.309590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:32.309901 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:32.310177 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] PATH_INFO: `/v3/users/26b64963a2bc4b579ab05af95690271c` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:32.311299 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26b64963a2bc4b579ab05af95690271c)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:32.313204 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:32.548896 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26b64963a2bc4b579ab05af95690271c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:32.550089 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26b64963a2bc4b579ab05af95690271c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:32.550238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26b64963a2bc4b579ab05af95690271c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:32.563045 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26b64963a2bc4b579ab05af95690271c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:32.642828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26b64963a2bc4b579ab05af95690271c'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:32.649104 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:32.656972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1443/2881] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:32 2022] DELETE /identity/v3/users/26b64963a2bc4b579ab05af95690271c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:32.661496 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92dd13-3d98-441a-8acc-57d669423f74 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:32.662007 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92dd13-3d98-441a-8acc-57d669423f74 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:32.662129 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92dd13-3d98-441a-8acc-57d669423f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:32.683133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-9c92dd13-3d98-441a-8acc-57d669423f74 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:32.684349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-9c92dd13-3d98-441a-8acc-57d669423f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:32.733361 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:32.745121 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1439/2882] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:32.761516 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:32.763208 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:32.824739 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc2744-dab9-49eb-89af-872a674a8332 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:32.828430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:32.829042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:32.829324 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:32.829597 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:32.839648 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:32.841142 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:32.853043 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1444/2883] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:32.957059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:32.957349 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:32.957629 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:33.007857 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:33.008988 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:33.074970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1440/2884] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:59:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:33.293391 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:33.294863 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:33.359344 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:33.361087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:33.379382 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0312762-ebf9-40f2-a746-da8ca41d152a None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:33.386029 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:33.386682 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:33.386970 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:33.387250 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] PATH_INFO: `/v3/projects/fe315edc863442a79fadd9d45843dc46` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:33.388458 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe315edc863442a79fadd9d45843dc46)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:33.390575 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:33.391658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e7b82-ed73-45ae-a21a-68844d0256a9 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:33.398687 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:33.399310 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:33.399590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:33.399864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:33.408868 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:33.410495 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:33.419882 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1445/2885] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:59:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:33.572775 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe315edc863442a79fadd9d45843dc46', 'request_id': 'req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.579316 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe315edc863442a79fadd9d45843dc46', 'request_id': 'req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.585392 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe315edc863442a79fadd9d45843dc46', 'request_id': 'req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.717986 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] The token cache is being invalidate because project fe315edc863442a79fadd9d45843dc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:33.718870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.718870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-0b8e314a-e2d5-4fd8-9e56-f2771e8a71aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.720395 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1441/2886] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:33 2022] DELETE /identity/v3/projects/fe315edc863442a79fadd9d45843dc46 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:33.724562 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:33.736037 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca0e42-8b7e-4d5e-b8e1-b682f033ea22 service swift] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:33.793297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:33.793972 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:33.794257 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:33.794535 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] PATH_INFO: `/v3/users/c5f7a4eabe4c4556bc2162d5d17a058d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:33.795673 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f7a4eabe4c4556bc2162d5d17a058d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:33.797631 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:33.808074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=100 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:33.982446 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f7a4eabe4c4556bc2162d5d17a058d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.983095 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f7a4eabe4c4556bc2162d5d17a058d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.983708 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f7a4eabe4c4556bc2162d5d17a058d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:33.995774 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f7a4eabe4c4556bc2162d5d17a058d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.094084 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f7a4eabe4c4556bc2162d5d17a058d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.107653 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1446/2887] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:33 2022] DELETE /identity/v3/users/c5f7a4eabe4c4556bc2162d5d17a058d => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:34.481917 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7075-e686-438e-8c56-2a258416e21b None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:34.487207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7075-e686-438e-8c56-2a258416e21b None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:34.487207 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7075-e686-438e-8c56-2a258416e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:34.503256 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-601c7075-e686-438e-8c56-2a258416e21b None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:34.504595 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-601c7075-e686-438e-8c56-2a258416e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:34.550833 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:34.561702 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1442/2888] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 24 03:59:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:34.574635 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:34.576033 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:34.645480 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f602c-236e-4d90-a373-4769a5b142f5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:34.651046 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c04374-7d4d-4652-a405-ba45b547fbf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:34.651798 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c04374-7d4d-4652-a405-ba45b547fbf4 service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:34.652083 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c04374-7d4d-4652-a405-ba45b547fbf4 service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:34.652614 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c04374-7d4d-4652-a405-ba45b547fbf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:34.661040 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c04374-7d4d-4652-a405-ba45b547fbf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:34.663195 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c04374-7d4d-4652-a405-ba45b547fbf4 service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:34.677209 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7075-e686-438e-8c56-2a258416e21b None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:34.677552 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1447/2889] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:59:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:34.684434 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-601c7075-e686-438e-8c56-2a258416e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:34.760427 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7075-e686-438e-8c56-2a258416e21b None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:34.765170 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:34.765856 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:34.766134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:34.766409 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] PATH_INFO: `/v3/projects/114366f0292e499d91c337aa63ba2a72` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:34.767586 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] RBAC: Authorizing `identity:delete_project(project_id=114366f0292e499d91c337aa63ba2a72)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:34.769541 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:34.867000 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '114366f0292e499d91c337aa63ba2a72', 'request_id': 'req-37595a6e-8809-4cd7-8c4c-327f343c101e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.873225 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '114366f0292e499d91c337aa63ba2a72', 'request_id': 'req-37595a6e-8809-4cd7-8c4c-327f343c101e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.879591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '114366f0292e499d91c337aa63ba2a72', 'request_id': 'req-37595a6e-8809-4cd7-8c4c-327f343c101e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.939562 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] The token cache is being invalidate because project 114366f0292e499d91c337aa63ba2a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:34.939863 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.940619 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-37595a6e-8809-4cd7-8c4c-327f343c101e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:34.942171 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1443/2890] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:34 2022] DELETE /identity/v3/projects/114366f0292e499d91c337aa63ba2a72 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:34.948189 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:34.948481 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:34.948785 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:34.968074 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:34.969281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:35.031677 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1448/2891] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:35.042052 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.042346 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.042651 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.063600 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:35.064841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:35.072862 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1444/2892] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:35.077455 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.088184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e4da6-0510-40ce-8cf6-1a6fd591e0c9 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.092786 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.093382 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.093692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.093999 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.094643 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 03:59:35.094949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.096678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.110740 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1449/2893] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Aug 24 03:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 03:59:35.114806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.124099 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d994-48ca-4c45-b987-36e81f1cf490 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.128796 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aafd9e-cae2-4a4c-ae11-016143a5d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.129398 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aafd9e-cae2-4a4c-ae11-016143a5d08a admin admin] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.129677 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aafd9e-cae2-4a4c-ae11-016143a5d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.129978 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aafd9e-cae2-4a4c-ae11-016143a5d08a admin admin] PATH_INFO: `/v3/projects` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.130591 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aafd9e-cae2-4a4c-ae11-016143a5d08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.132509 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aafd9e-cae2-4a4c-ae11-016143a5d08a admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.203924 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1445/2894] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Aug 24 03:59:35 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:35.208280 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.215370 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:35.219606 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3fa5-ed4a-4eb6-84d2-ecef9c03dbdb admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.279678 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.280297 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.280580 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.280885 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] PATH_INFO: `/v3/users` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.281524 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.283487 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.332911 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.333264 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.333607 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.354998 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:35.356127 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:35.405805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1450/2895] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Aug 24 03:59:35 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 03:59:35.409007 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.416215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1446/2896] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Aug 24 03:59:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 03:59:35.419059 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170be12-c1aa-4b03-b4fc-b72859f4e66e admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.423817 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.424413 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.424691 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.424965 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.425679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.427281 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.429020 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.430436 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:35.435508 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:35.438582 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1451/2897] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:59:35.442471 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.452951 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433083-22f5-47a0-9b4e-98b55e4cd2de admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.457996 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.458612 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.458894 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.459176 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.460395 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.462025 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.472501 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1452/2898] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Aug 24 03:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 03:59:35.477053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.486787 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df96484-f782-4dc7-8f14-391be187d25b admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.491737 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.492392 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] REQUEST_METHOD: `PUT` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.492704 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.492947 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] PATH_INFO: `/v3/projects/911410dbfe0c4eb9a286be3c51d7ddbd/users/4c7c8f858a82462883a68691bef5a4e9/roles/9386846542804a8b96776ed9753a7628` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.507133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62100b7-dd57-42cc-a60b-ff892813ccbc None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.509504 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911410dbfe0c4eb9a286be3c51d7ddbd, user_id=4c7c8f858a82462883a68691bef5a4e9, role_id=9386846542804a8b96776ed9753a7628)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.512076 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.512845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32effe4b-e6e6-4768-95a2-00d1e0c4526f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.513454 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32effe4b-e6e6-4768-95a2-00d1e0c4526f service swift] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.513740 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32effe4b-e6e6-4768-95a2-00d1e0c4526f service swift] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.514041 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32effe4b-e6e6-4768-95a2-00d1e0c4526f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.523750 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32effe4b-e6e6-4768-95a2-00d1e0c4526f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.525324 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32effe4b-e6e6-4768-95a2-00d1e0c4526f service swift] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.533831 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1447/2899] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:59:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 03:59:35.632282 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1453/2900] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Aug 24 03:59:35 2022] PUT /identity/v3/projects/911410dbfe0c4eb9a286be3c51d7ddbd/users/4c7c8f858a82462883a68691bef5a4e9/roles/9386846542804a8b96776ed9753a7628 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 03:59:35.643729 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf229e-f50a-40d2-a947-9fe44bb58b23 None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.644015 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf229e-f50a-40d2-a947-9fe44bb58b23 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.644291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf229e-f50a-40d2-a947-9fe44bb58b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.672736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-e0bf229e-f50a-40d2-a947-9fe44bb58b23 None None] MFA Rules not processed for user `4c7c8f858a82462883a68691bef5a4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:35.674168 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-e0bf229e-f50a-40d2-a947-9fe44bb58b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:35.741689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1448/2901] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:35.752946 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:35.754684 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:35.812805 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206be84-ebfc-4334-90f8-9bb4afc77665 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:35.816523 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db35ea7cc80d49caa8187dcde2d55642', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:35.817128 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:35.817415 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:35.817692 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:35.826861 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:35.828323 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:35.837396 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1454/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:36.272926 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] REQUEST_METHOD: `POST` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:36.273431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:36.273539 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:36.293488 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.auth.core [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] MFA Rules not processed for user `f5c5765e56b848d4a8091de1570bfbc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81789) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:36.294747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:36.351180 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1449/2903] 10.222.0.40 () {58 vars in 967 bytes} [Wed Aug 24 03:59:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:36.364199 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:36.417658 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:36.434234 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faad334-f462-4a23-9700-f27aba7ebe82 service cinder] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:36.439448 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f7c4-c6d6-4859-b390-0252c97e1ceb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86600b9afdbf43808b4745828a1d3756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:36.448613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f7c4-c6d6-4859-b390-0252c97e1ceb service swift] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:36.448613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f7c4-c6d6-4859-b390-0252c97e1ceb service swift] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:36.448613 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f7c4-c6d6-4859-b390-0252c97e1ceb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:36.450557 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f7c4-c6d6-4859-b390-0252c97e1ceb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:36.452224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f7c4-c6d6-4859-b390-0252c97e1ceb service swift] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:36.460891 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1455/2904] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Aug 24 03:59:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 03:59:39.470538 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:39.472005 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:39.503098 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=100 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:39.545173 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7dbce-5b36-48f0-97dc-468fd31f8a9c None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:39.549840 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:39.550497 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:39.553331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:39.553331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] PATH_INFO: `/v3/users/ab7985b06ead4389a37d0f2c9b77eaf5` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:39.553331 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7985b06ead4389a37d0f2c9b77eaf5)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:39.554810 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:39.896860 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7985b06ead4389a37d0f2c9b77eaf5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:39.897515 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7985b06ead4389a37d0f2c9b77eaf5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:39.898140 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7985b06ead4389a37d0f2c9b77eaf5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:39.910301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7985b06ead4389a37d0f2c9b77eaf5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:39.985281 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7985b06ead4389a37d0f2c9b77eaf5'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:39.998388 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1450/2905] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:39 2022] DELETE /identity/v3/users/ab7985b06ead4389a37d0f2c9b77eaf5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:40.002970 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:40.003467 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:40.003569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:40.022355 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:40.023590 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:40.082855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1456/2906] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:40.093298 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:40.094746 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:40.152907 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040844-5cde-422d-a0e8-75d680301dd0 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:40.156786 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:40.157391 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:40.157672 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:40.157974 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:40.167011 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:40.168431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:40.178031 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1451/2907] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:40.399365 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:40.400827 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:40.414383 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc98fd-426c-4a6f-bf9d-904f9bc3dea1 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:40.419183 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:40.419828 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:40.420105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:40.420379 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] PATH_INFO: `/v3/projects/5b279c970d744d7791300422d2bb96df` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:40.421513 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b279c970d744d7791300422d2bb96df)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:40.423600 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:40.586347 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b279c970d744d7791300422d2bb96df', 'request_id': 'req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:40.592602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b279c970d744d7791300422d2bb96df', 'request_id': 'req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:40.688111 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b279c970d744d7791300422d2bb96df', 'request_id': 'req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:40.699636 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] The token cache is being invalidate because project 5b279c970d744d7791300422d2bb96df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:40.699923 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:40.700544 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-31ff3cf8-2cd2-484b-ad1e-999bce8c6c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:40.702069 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1457/2908] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:40 2022] DELETE /identity/v3/projects/5b279c970d744d7791300422d2bb96df => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:42.127351 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:42.128762 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:42.141523 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028e8a1-c3b3-42f5-bc64-9d193f71444e service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:42.186691 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:42.198174 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:42.203769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:42.203769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:42.203769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] PATH_INFO: `/v3/users/4c7c8f858a82462883a68691bef5a4e9` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:42.203769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7c8f858a82462883a68691bef5a4e9)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:42.203769 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:42.360532 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7c8f858a82462883a68691bef5a4e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:42.361137 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7c8f858a82462883a68691bef5a4e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:42.361736 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7c8f858a82462883a68691bef5a4e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:42.374689 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7c8f858a82462883a68691bef5a4e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:42.448291 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7c8f858a82462883a68691bef5a4e9'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:42.462363 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1452/2909] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 03:59:42 2022] DELETE /identity/v3/users/4c7c8f858a82462883a68691bef5a4e9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:42.467026 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:42.467511 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:42.467641 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:42.487971 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] MFA Rules not processed for user `84b18f6adbc04f4f94e86ebc7dc7e8e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 03:59:42.489205 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:42.550472 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1458/2910] 10.222.0.40 () {58 vars in 958 bytes} [Wed Aug 24 03:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 03:59:42.560491 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:42.561956 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:42.623301 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fcc80-dea0-4869-878c-495ab50e093f admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:42.627166 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:42.627774 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:42.628054 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:42.628327 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:42.637684 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:42.639153 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:42.649149 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1453/2911] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 03:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 03:59:43.182231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 03:59:43.183764 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 03:59:43.192655 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:43.196536 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7127c4-d1c4-4cf8-991b-da917b037972 None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 03:59:43.202036 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 03:59:43.202679 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 03:59:43.202959 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 03:59:43.203231 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] PATH_INFO: `/v3/projects/911410dbfe0c4eb9a286be3c51d7ddbd` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 03:59:43.205116 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911410dbfe0c4eb9a286be3c51d7ddbd)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 03:59:43.207042 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 03:59:43.352188 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911410dbfe0c4eb9a286be3c51d7ddbd', 'request_id': 'req-91af609b-3fbc-4d41-84f7-f9946a9f09c5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:43.359352 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911410dbfe0c4eb9a286be3c51d7ddbd', 'request_id': 'req-91af609b-3fbc-4d41-84f7-f9946a9f09c5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:43.493873 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911410dbfe0c4eb9a286be3c51d7ddbd', 'request_id': 'req-91af609b-3fbc-4d41-84f7-f9946a9f09c5'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:43.505044 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] The token cache is being invalidate because project 911410dbfe0c4eb9a286be3c51d7ddbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 03:59:43.505335 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:43.506005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 03:59:43.507537 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1459/2912] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 03:59:43 2022] DELETE /identity/v3/projects/911410dbfe0c4eb9a286be3c51d7ddbd => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 03:59:52.644448 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 03:59:53.802532 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:28.096130 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:28.097587 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:28.168100 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d541a3-fb48-448c-aeb9-d8718d6688f3 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:28.233900 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:28.234517 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:28.234800 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:28.235075 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:28.236868 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:28.248309 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:28.249938 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496d33-6ad9-4d4e-aa06-434126c4996e service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:28.260550 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1454/2913] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:29.602184 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:29.603680 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:29.664224 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af609b-3fbc-4d41-84f7-f9946a9f09c5 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:29.668147 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:29.668763 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:29.669065 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:29.669320 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:29.671105 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:29.680864 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:29.682438 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958d970-9bd2-471d-a53d-5865b1fd8736 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:29.690596 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1460/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:29.766568 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20269bb-d0f8-412b-b652-2673e5078401 None None] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:29.767022 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20269bb-d0f8-412b-b652-2673e5078401 None None] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:29.767133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20269bb-d0f8-412b-b652-2673e5078401 None None] PATH_INFO: `/` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:29.768498 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1455/2915] 10.222.0.40 () {54 vars in 921 bytes} [Wed Aug 24 04:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:01:29.775482 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] REQUEST_METHOD: `POST` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:29.775772 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:29.776053 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:29.814345 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.auth.core [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] MFA Rules not processed for user `afdf5eda0a634fe48781ef984f7bf496`. Rule list: `[]` (Enabled: `True`). {{(pid=81788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:01:29.815567 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:29.882463 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1461/2916] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Aug 24 04:01:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:01:29.892997 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20269bb-d0f8-412b-b652-2673e5078401 None None] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:01:29.894710 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a20269bb-d0f8-412b-b652-2673e5078401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:01:29.908570 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20269bb-d0f8-412b-b652-2673e5078401 None None] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:01:29.912125 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:01:29.912726 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:01:29.913040 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:01:29.913318 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:01:29.923414 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:01:29.924841 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:01:29.936288 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1456/2917] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:01:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:01:39.872308 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=63 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:01:39.931581 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=64 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:18.435289 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:18.444858 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3938647-269f-4bac-95a4-a1d5f491e73a None None] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:18.448589 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:18.449197 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:18.449475 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:18.449751 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:18.451496 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:18.515834 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:18.518179 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:18.527529 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1462/2918] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:19.447469 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:19.448967 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:19.466364 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a935cf-53fc-42b4-aeff-288d9272edc4 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:19.472639 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afdf5eda0a634fe48781ef984f7bf496', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:19.473263 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:19.473671 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:19.473991 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:19.475875 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:19.490747 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:19.493059 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:19.505355 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1457/2919] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:19.922416 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:19.931794 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfa889-6110-4646-9da5-89b795f67556 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:19.936238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:19.936857 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:19.937137 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:19.937420 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:19.940386 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:19.956366 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:19.957949 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:19.971924 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1463/2920] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:21.430526 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:21.440215 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fe743-18de-45fa-badc-2b18ee45df8c service nova] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:21.444133 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:21.444838 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:21.445196 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:21.445477 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:21.447413 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:21.464516 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:21.468431 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:21.480845 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1458/2921] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:25.236422 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:25.245913 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5846a38b-ea99-4029-91f8-de7ae501331d service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:25.249575 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21235d5078fc408da2d9f4e35ab51a79', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:25.250284 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:25.250569 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:25.250850 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:25.253230 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:25.318119 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:25.319558 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:25.329182 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1464/2922] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:28.783872 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:28.785294 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:28.800087 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b6392-e9c5-41e0-abd3-6c0149984452 service neutron] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:28.806859 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:28.807615 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] REQUEST_METHOD: `GET` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:28.808032 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:28.811816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:28.811816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:28.824893 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:28.826593 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:28.837134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1459/2923] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:03:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:03:32.609244 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:32.610855 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:32.623852 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f62ea-77da-4f77-a7e5-7f85471bb5a0 service neutron] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:32.628707 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:32.629430 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:32.629714 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:32.630029 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] PATH_INFO: `/v3/users/9e4f4a622faa41f3a996fdefffd09361` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:32.631167 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e4f4a622faa41f3a996fdefffd09361)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:32.633080 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:32.809206 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e4f4a622faa41f3a996fdefffd09361'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:32.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e4f4a622faa41f3a996fdefffd09361'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:32.817093 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e4f4a622faa41f3a996fdefffd09361'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:32.823005 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e4f4a622faa41f3a996fdefffd09361'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:32.916433 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e4f4a622faa41f3a996fdefffd09361'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:32.918956 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:32.929602 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1465/2924] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 04:03:32 2022] DELETE /identity/v3/users/9e4f4a622faa41f3a996fdefffd09361 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:33.213175 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:33.224111 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188b6dc-53fb-44f5-bfb9-743597ffc524 service placement] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:33.291551 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:33.292621 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:33.293134 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:33.293734 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] PATH_INFO: `/v3/projects/2cde328428bb4ca9b1710a760f1f33da` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:33.295735 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cde328428bb4ca9b1710a760f1f33da)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:33.300092 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:33.459763 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cde328428bb4ca9b1710a760f1f33da', 'request_id': 'req-f52842f1-ff3e-4480-a459-2ade54c1eb64'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.468583 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cde328428bb4ca9b1710a760f1f33da', 'request_id': 'req-f52842f1-ff3e-4480-a459-2ade54c1eb64'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.473126 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cde328428bb4ca9b1710a760f1f33da', 'request_id': 'req-f52842f1-ff3e-4480-a459-2ade54c1eb64'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.555678 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] The token cache is being invalidate because project 2cde328428bb4ca9b1710a760f1f33da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:03:33.555973 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.556597 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.558103 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1460/2925] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:33 2022] DELETE /identity/v3/projects/2cde328428bb4ca9b1710a760f1f33da => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:33.562209 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:33.565601 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:33.576940 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebd553-0e51-428c-87ac-5e9b7f405a53 admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:33.636061 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:33.636728 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:33.636884 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:33.637159 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] PATH_INFO: `/v3/users/a083fbbd953d4ce19157568cdc4d556d` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:33.638350 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a083fbbd953d4ce19157568cdc4d556d)` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:33.640270 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:33.896238 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a083fbbd953d4ce19157568cdc4d556d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.896820 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a083fbbd953d4ce19157568cdc4d556d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.897439 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a083fbbd953d4ce19157568cdc4d556d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.910265 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a083fbbd953d4ce19157568cdc4d556d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.984661 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.notifications [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a083fbbd953d4ce19157568cdc4d556d'} {{(pid=81788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:33.998172 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1466/2926] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Aug 24 04:03:33 2022] DELETE /identity/v3/users/a083fbbd953d4ce19157568cdc4d556d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:34.260257 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Authenticating user token {{(pid=81789) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:03:34.261816 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.fernet_utils [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81789) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:03:34.276035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52842f1-ff3e-4480-a459-2ade54c1eb64 admin admin] Validating token access rules against request {{(pid=81789) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:03:34.325557 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:34.336806 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84b18f6adbc04f4f94e86ebc7dc7e8e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a304260abbd4fa38198d15914f9035c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81789) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:03:34.337446 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:03:34.337728 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:03:34.338035 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] PATH_INFO: `/v3/projects/3b20f3bbe2f54f53991f2f68456aae54` {{(pid=81789) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:03:34.339194 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b20f3bbe2f54f53991f2f68456aae54)` {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:03:34.341108 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] RBAC: Authorization granted {{(pid=81789) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:03:34.459337 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b20f3bbe2f54f53991f2f68456aae54', 'request_id': 'req-d8f151fa-143b-4023-b6f7-16a160039f7e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:34.466325 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b20f3bbe2f54f53991f2f68456aae54', 'request_id': 'req-d8f151fa-143b-4023-b6f7-16a160039f7e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:34.473001 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b20f3bbe2f54f53991f2f68456aae54', 'request_id': 'req-d8f151fa-143b-4023-b6f7-16a160039f7e'} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:34.530870 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] The token cache is being invalidate because project 3b20f3bbe2f54f53991f2f68456aae54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81789) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:03:34.531183 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:34.531881 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG keystone.notifications [None req-d8f151fa-143b-4023-b6f7-16a160039f7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81789) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:03:34.533803 dv-cinder-854261-1-smb devstack@keystone.service[81789]: [pid: 81789|app: 0|req: 1461/2927] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Aug 24 04:03:34 2022] DELETE /identity/v3/projects/3b20f3bbe2f54f53991f2f68456aae54 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:03:43.994258 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=57,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:03:44.527674 dv-cinder-854261-1-smb devstack@keystone.service[81789]: DEBUG dbcounter [-] [81789] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81789) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:06:57.845750 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Authenticating user token {{(pid=81788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:06:57.847353 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:57.999801 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac0b4e-ef1d-469c-a474-fbbdaf065bdf admin admin] Validating token access rules against request {{(pid=81788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:06:58.073048 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '411e88250df044a993d8eb39d988390b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f2cd7bacc114313a9a83d8bacdefdcf', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:06:58.073671 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] REQUEST_METHOD: `GET` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:06:58.073974 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] SCRIPT_NAME: `/identity` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:06:58.074754 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:06:58.076807 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.fernet_utils [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:06:58.089071 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:06:58.091493 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cb01ac-2093-41f7-b312-bf802bbb8666 service placement] RBAC: Authorization granted {{(pid=81788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:06:58.103572 dv-cinder-854261-1-smb devstack@keystone.service[81788]: [pid: 81788|app: 0|req: 1467/2928] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Aug 24 04:06:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:07:08.099145 dv-cinder-854261-1-smb devstack@keystone.service[81788]: DEBUG dbcounter [-] [81788] Writing DB stats keystone:SELECT=89 {{(pid=81788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}